I would say this is typical of most big game rifles...some show this worse than others...yours doesn't sound too bad...If you glass bed the action and free float the barrel it MIGHT help...then again it might not...each gun seems to have a mind of its own....If you are using for deer...I'd leave it alone...

Often free floating the barrel helps "center" the group or, if a wooden stock helps keep the groups from moving because of stock warpage etc...but, the group may also open up...