Although, for what you want to use it on, there is virtually no difference in killing power, I cast my vote for the 30-06.

I would recommend starting with something like the reduced recoil 125 gr bullets so the recoil doesn't start you down the path of flinching. This load is plenty for whitetail sized game. Later, you can move up to the 150 to 165 gr bullets as you move on to bigger game.