Since you are talking mainly about target shooting versus hunting,
(bad shots will only hurt your ego, not animals, especially on long range shooting!)
I'd have to agree, the .223 is going to be your cheapest, and best upgrade to the .22 Rimfires!