Biggest buck I ever killed was in a storm that was freaking me out. I was sitting on top of a big overturned root ball and thought I may get hit by a tree. But I was after my boy and I was pretty sure I had him figured out, and I did. Just before dark, he belonged to me. When I shot him there were three doe standing all around me. One small one to my right was so close I could have tossed my pack onto her back. They looked freaked out too. I'm not sure if that was because the wind was crazy and they kept getting wind of me, or if they just didn't feel good around all the blowing trees either. Either way, there we all were, spending some quality time together in a storm.
I'm pretty sure that deer have to eat more in times of cold weather, hard winds and rain. All of these things require calories to overcome. Besides, it wouldn't surprise me if deer haven't figured out that us domesticated primates like to be indoors during such weather and get a little lazy.
Go hunt it man! My season doesn't start until Oct 6, so as you're probably aware of, it is going to take a lot more than 15 mph wind to keep me from going out!