The intent is to have the wind blow from the deer to you, not the other way around. It doesn't matter what side of their face they smell you from. Your scent shouldn't be going in their direction.