Sounds like he already had hens.Are people messing with him before the season?Are you using friction or mouth calls?Yelps,clucks,cutts,purrs?
What time of day are you hunting him,early morning,late morning or both?Does he ever gobble going away from you?Not trying to be a smart ars but with the answers to the questions I might be able to give you some pointers.