The bolt is a problem, and there is a really good chance that feeding will also have issues.
If I had that situation I would find another take-off barrel in a cartridge that uses the same family of case. I changed a 7mm RM into a .338 WM with a barrel swap. No problems at all with bolt or feeding.
CDNN has take-off barrels, as do many other vendors, but I usually can find one locally for about $40 - $50. I remember being in the building of Douglas Barrels and seeing 55 gallon drums full of take-off barrels that they were sending out for scrap value.
You could probably get your take-off .30-06 rechambered in .300 WM for a good bit less than reworking the action to use the .30-06 barrel. A mild load for the .300 WM can turn it into a .30-06 equivalent.