The key is that the colors are broken up and not in one big blob. Deer don't see colors at all and their vision is completely different than a human's or a predator's.

I've been 25 yards from a deer with a blaze orange vest and hat and the deer never saw me even though it was looking right at me. The key is motion and blending with your background.

Camo is not going to hurt you by any means, but if you are warm and cozy with a nice jacket and not moving you are probably going to be better off than if you were cold and moving around in full camo.

I do wash my hunting clothes separate from my other clothes and use detergent that doesn't have any UV brightners in it like most commercial detergents do. UV will show up to a deer as you noted in your reading. Some camo has UV brighteners in it and sticks out like a sore thumb to a deer but looks awesome to a person. Might not hurt to wash your coat a few times in a detergent without any UV brightners just to make sure or look at it under a black light and see if it glows.