Aahhh... The plot thickens...

Those hens will probably move and the tom will go with them. Maybe not far, but those ol' gals can get jealous and uncooperative.

What I'd try now, is to give them a little time ( a week maybe) and go at him from a different direction. He probably won't come to you because the hens will lead him off. After I know he's gone, I'd go hunt another bird AWAY from the direction they went. THEN I'd come back about 8:30 or 9:00 and see if he comes back looking for that other hen that didn't join up with him. This may take a few days of frustration on your part, but be patient. Sooner or later those hens are going to start slipping off to nest and he'll get lonesome.

It's worked for me before.

Good luck!