Its possible that the hens were roosted fairly close to the gobbler but got spooked sometime that night and flew off a ways or the other way around. At first light the gobbler just headed in their direction. I bumped a bunch of hens off the roost late one evening while trying to roost a gobbler. The hens flew off but the gobbler stayed put about 50 yards away.
The next morning I set up about 200 yards from the gobbler in the path the hens flew the evening before. At dawn the gobbler gobbled once and flew down and walked directly to me. I never called once.

Turkeys have a small brain but seem to have a very good memory.