Do you shoot with one eye open of both? What I do is when I pick out new frames I always pretend I'm at full draw to make sure that I don't have that problem. You may also want to try to turn your head a little until you are looking through your lense.