Ive got a blue light as well. It just makes it worse for me as I can already see the pins just fine and the light just makes it harder to see beyond the sight.
I might just have to go back to the big square sight. Ive shot just fine with that for 20 years. The small round sight lining up up with my peep gives me a little more accuracy long range in the broad daylight with a bullseye to shoot at but its just not working for me in the woods at all.
I find my self doing exactly what your saying. Taking my eye out of the peep to see the deer and back in to try to get the pin where I want it.
It would be pointless for me to take the pins out because my accuracy at long range is the only advantage of having the small round sight in the first place.