Buckmastr229, the 30-06 is as good as any deer caliber made!
It can be considered overkill, but if you can handle it, there nothing wrong with overkill! I happen to overkill 'em with a 7MM RM and .308!
The .243 with 100 grain bullets, is my minimum for deer, but within reason, it is a VERY GOOD minimum!
Something in .260 or 7MM-08 could really be considered to be perfect for deer!
I suspect by your post, (.243 sissys gun) that you may be feeling the "more is better, magnum-itis! Don't get caught up in this! Shoot the largest gun you can handle and shoot WELL!
Deer are not particularly hard animals to kill, so anything from .243 on up will work if you do your part! Good Luck!