You may want to give him a day or two rest before you go after him again. As long as he has the hens he'll be tough to hunt. Usually they say if you can call the hens the bird will follow. I haven't found that to be true. The opposite has been true all to often. He'll work the hens he's with in the AM, but usually by 11 or 12 he's sent them all to a nest and he'll come back looking for that pretty lady he heard earlier in the AM that wouldn't come out. Change the calls type and tone a little if you're worried he'll be spooky. Doesn't sound like you spooked him at all to me. He just wanted to go the other way. Certainly in a couple weeks when they hens are through with him he'll be looking really hard for any date and will be receptive to just about anything.