RE: how to handle this
That's a tough call. I use to hunt a spot that as soon as I stepped off the home owners porch deer scattered in every direction all through the woods. I can say even though the amount of deer was consistent throughout the hunts the big boys were seen less and less.
If it were me I would still hunt it but not very often exspecially if you have other places. You may try to wait until the rut and go there at first light.
Good luck.