I think you did. I know a couple of guys that have switch barrel guns. They never seem to switch barrels though.
I have a .22 long rifle and .22 Mag barrel for a little knock-around NEF. I don't think I've switched barrels more than once.
I have a .45 and a .54 barrel for my TC Renegade and I'm looking for another Renegade stock so I don't have to switch barrels. I've come to the conclusion that two guns are better than one gun with two barrels.