ORIGINAL: TWIRPY
It sounds to me like your draw length on your bow is too long. I wear glasses and don't have any problem. I have noticed that if I pick up someone else's bow with longer draw length it is a problem. Make sure that your draw length is correct. Your head should be perfectly straight and eye dead center of string with correct draw length. Hope this helps.
Agreed,you must be drawing to far back your head should be looking more straight ahead!