Unless its a large amount of black, as in a hunter wearing all black in a stand, I don't think it raises any flags for deer.

The straps on my stand are black, the accesories on my bow are black, the soles of my boots are black... Doesn't seem to bother them at all.

I think we as hunters give deer too much credit. Granted, they're smart to an extent, but they aren't humans.