Do you have a trail cam out? The trail may be heavily used at night though it sounds like you have a lot of pressure around the area, maybe they are throwing the pattern off? Also are you hunting the trail and the wind together?
I have a 10 point running a trail in the 9 pm range, just have to wait for him to make a mistake earlier in the day....
Today the wind was terrible until the late afternoon in the southern part of the state, I didn't hear many shots.