30-06 is a great choice. That would be my pick for the reasons you're hearing.

The .308 will work, and the end result will not be any different--dead deer.