I have loaded Speer 130 grain HP in an '06 for deer but I had to limit shot placement to head and neckshots because at almost 3000 fps (measured) the tend to blow up on impact and penetration is only about one body width through SOFT tissue - if you hit even one rib you have a wounded animal. I got sub-MOA accuracy and had no problems other than having to wait for a deer to give me a good shot. It was an experiment that my brother talked me into and it worked under the conditions it was loaded for but I went back to my 165 grain BT because there are no limitations on that bullet other than range and if it is too far for that bullet it is out of my shooting skills to shoot at. (ok, maybe not but I don't shoot past 200 yards anyway - point of aim from the muzzle to impact +/- 1 inch is my person choice of limitation.
The Spire point driven at high velocity will kill but it is just light enough to stop when it hits a bone or fragment into pieces too small to kill. If you don't mind being limited in your shots then try it out. If limits bother you then step up to a heavier bullet - 150 to 165 are the best you can ask for when the target is medium sized and easy to kill. Bigger animals will need bigger bullets and bigger bullets are limited by the powder capacity of the '06. There is a big drop in velocity from 165's to the 180 grain bullets and that means that trajectory is steeper. It is one of those trade-offs that we all enjoy playing with.
PaulS