The last time I harvested a canny Buck in roughly the same situation, I caught him between where he bedded and a rub line he visited pretty regularly. I actually set up in a direct line between his bed and the rub. Maybe 125 yards from his bed and 25 from the rub. I set up behind a fallen tree.

Maybe the fourth time I set up there, he got up early to visit his rub in the evening ( an hour or more before last light) before going to feed.

Sounds like he is pretty territorial and likely has a rub line within a hundred yards of where he sleeps.