Shed33 makes a great point.

Deer don't always travel into the wind though. If they did there would be a lot less of them killed. They will usually approach decoys and things they are interested in checking out from down wind, but if they are comfortable they just move around as they please. Just like us there are three things that dictate their movements: sleep, food, sex. The trick is trying to stay upwind of them while they try to accomplish all of that.