Every single load I have ever shot out of my 3006 has always flattened the primer for me. Some of those were even below minimum listed grains in some manuals. If they eject fine, and you not getting cracks in your brass you should be okay IMO. Watch your brass.

I think the companies that put out load data keep it on the lower, more safe side, because they don't know who is using the data or what the condition of the gun is that it will be fired from. They don't want a law suit or to get anyone hurt. On case life, I quit full sizing my brass and shoot it fire formed now. I find that is making a difference because I had some that cracked right at the spot at the base of the case that expands out.