.25-06 for up to Deer because of the heavier bullets which can be used and there is enough power for Deer and the lesser weight bullets can be used for Varmints.

I personally would use the 24 caliber's strickly for Varmint.