If you can handle the 12 Ga slugs, you can handle the .30-06.

Just a tip, while you're sighting it in from the bench take along one more sandbag than you need. Put it between the gun and your shoulder. That really helps.

I do this even with a .270 and with a .375 H&H I use a special bag with very heavy foam.