I've been busted by one of two things: in my earliest days, I got nailed a couple of times trying to raise a gun to my shoulder for a shot. I had to learn to do it w/o being seen.
The other was turning my head too quickly, especially after hearing leaves scrunching. I now wear a face mask and am much more discreet.