In most cases, no. Better to have a little extra firepower than to show up under-gunned.
Having said that, I've shot a couple whitetails with a .300 Win mag. Big exit hole on the way out, wasted more meat than I was happy with. A little too much firepower for deer.