I wear camo, it costs about the same amount as any other clothes out there unless you buy into the scent control clothing. Primary reason I wear camo is not for the deer but for the other animals that can also alert the deer. Camo has saved me from spooking turkeys, squirrels, yotes. Each one of them especially squirrels are capable of putting deer on high alert and so my primary objective is to not alert deer, by any means.
Now one of my thoughts about the natural colors like a nature photographer, or even regular work clothes is i dont think deer associate them with hunting. Have been out many times outside of season and deer just dont seem to care about me. But as soon as they see you in camo or fatigues during deer season they are quick to take off. Have been in the field here on base with a group of Marines sleeping in their hummers and deer even walked right between the trucks in the dark not caring at all.