If it's just recoil, I'd go with a .243. I think this cartridge is about the smallest you should go for deer, and it kicks like a pellet gun.

Best part is availability of rifles and ammo in this caliber. Not very expensive either.