Sounds like you have parallax problems. IMO
I would suggest make it so you hold your head the same every time. (pad buttstock etc.) Or go to lower rings so you can rest on the stock.
Most shot gun scopes, if that is what you have, are set parallax free at 75yrds.