I used to hut with a face mask, now that I can finally grow a beard I haven't hunted with one for years. And I can say that it doesn't bother deer. When I have a good buck close I raise my bow to break up my outline of my face, that works awesome. I have also tried camo paint and I think that gives off a clay smell or something, so I don't use that anymore. I'm just guessing that the buck came in looking for a fight and zoned into your calling and when he didn't see any deer around looking for a fight, he got nervous, A decoy is good in that situation, but I have also seen them come in, see the decoy and take off. So when I hunt with a decoy I take one antler off and then he appears to be a easy win in a fight situation and they come in ears back. Good luck and get after them.