I think you are ok. It looks like the hunting pressure around you is even to what you have. What you don't want is more people that would concentrate the pressure in the space your hunting, and push the deer to the surrounding land with less pressure, or cause all the deer to go nocturnal.

Of course, as AJ52 pointed out...there are a lot more factors than just how many people are around.