Just an idea, maybe you are laying down what I call a scent fence when you are walking in. Not only are some Deer hesitant to follow a trail with human scent on it, they can even be hesitant to cross a trail of human scent.

I had one hunting area where, in many years of hunting there, I never saw a Deer come in the same direction I walked in. I'm talking about a whole compass direction or a half circle. They'd come in from due West and sometimes from the South east. I usually walked in from the North. Wind was typically West to East.

Not much foot traffic or contact with humans there, human scent would spook them. I wash with base soap, which is getting hard to find here.

Something else about this spot, the Hogs would cross periodically North/South, usually North to South, sometimes the opposite direction, The Deer avoided the Hog trails, almost those two compass directions. I'm talking a wide swath maybe a fifty yards wide or wider. It is like the Deer just refused to walk the same ground as the Hogs did. When the Hogs were coming, the first tip off was often a Deer leaving in a panic, usually a Doe with a fawn. Deer are notional, I've seen them feeding right next to the Hogs, most Deer fear them, especially the Doe with Fawn.

Maybe you have some Yotes Hunting that area?

I had one area that was rich with Deer, just dry up. Took me months to figure it out. A pair of Dogs would make a loop most every night, they'd walk themselves. My guess is the owner would let them out and they'd come home again a couple of hours later. I saw their sign numerous times, one large Dog one medium Dog. I never did actually see them. I imagine Yotes could cause the same thing.

Just some ideas.

I use my Jeep to scout. I set up on a good spot with a good view and a pair of Binoculars. I usually setup way early 3 A.M. and just sit in the Jeep and watch. Once I get an idea of Deer movements I place my high seat or blind. Full Moon is a good time for this. And/or using farm roads and checking tracks after a rain or snow.