If it's a lighter deer caliber that you want, I'd go with the .243. It is a great minimum caliber for deer, and will double as a good varmint gun.
If you want a varmint caliber, the .223 is good and cheap to shoot! It just ain't a good deer caliber!