Total deer movement during higher winds gets them to bed longer, but you will still see plenty of deer on their feet and usually eating. If it's a buck during the rut, he doesn't even know he's alive. He's too busy lookin' for some tail.
And, yes, to your assumption on where they move to in the wind. However, for deer to move in thicker areas with wind breaks, the temperatures usually are colder. If you can think of areas that are out of the cold wind, yet catch some sun light, those are good places to still hunt through. South facing banks out of the wind, regardless of cover, are good places to glass or hunt looking for them.
If the does are spooky because of the wind and you have bucks following them, and the does bed down, the bucks will do likewise.
Don't let wind ever be a deterrent to tell you not to hunt. It's usually one of the few occasions the odds tilt in the hunter's favor under those conditions.
iSnipe