Yup. I've had it happen more times than I care to admit, which is one of the reasons I don't see many mature bucks, IMO. I've shot several does that not only approached from downwind, but were downwind when I shot them.
Bucks can smell better than does?