Diesel pegged my suspicion which is that where you have set up, the deer may not be there until dark and may not visit there often.

It also does not take much more than a few does going in and out of an area a few times to make an area look well used.

Outside of the rut, deer are pretty predictable and stick to somewhat regular patterns with nothing pushing them. You might just have a "bad" spot picked out.

You may also be hunting an area where the deer are there when you arrive. If you spook them out a couple times without knowing it, they'll pattern you and hang out just far enough away to avoid you.

As suggested, do some mid-day scouting following the trails looking for trail intersections, old rub lines or scrape lines nearby.