If I am hunting in a public area, I always wear an orange vest AND an orange hat, regardless of whether or not it is required. Deer do not see the orange color. I have seen studies that determined that deer were able to discern blue, but notorange. I have had deer and elk walk within 10 feet of me and not see me, even though I was in full view. I have never once thought that the orange I was wearing spooked game, but it sure lets other hunters see me!

In the car, it is buckle up,
in the woods it is orange up!

I also put hunter orange on anthing I am carrying on a backpack that might be mistaken as an animal part: Antlers, etc.