Hm, you got me stumped there. I shoot with both glasses and contacts, and my anchor is the same regardless. Just thinking outloud, but perhaps your peep needs to be reset and your anchor adjusted a little??