It makes sense that the image would not be as clear. Glasses just add another lense to the system, reducing light transfer. Your glasses probably have some scratches too.

Many people don't realize that scopes need to be focused for the user's eye. I shoot with glasses, and if a person with good eyesight (no correction) looks through my scope they think the scope is not very clear.