Not to worry. Wash your camo with a scent free cleaner, let it dry outside then treat it with UV Blocker. I've been using this stuff for years. I still use camo from the '80s. Everything had the UV brightners. Heck, I kill a 10 point this year while I was wearing some of the "Original Realtree" camo that I had treated with this stuff. It'll cancel out the "glow" as tested with a black light.
http://www.atsko.com/products/uv-protection/