Cue the banjo music...........
I had a similar story about 6yrs back with a guy who looked up at me in my stand and then pulled his shorts down and pee'd all over the tree with the posted sign on it 30 yards from my stand. This after he saw a buck heading to me and got down out of his stand illegally ON PRIVATE LAND to scare it away. I have honestly never been so mad in the woods in my life (Well maybe after I lost all my crap this season?

).........Anyway.
I guess he couldn't determine scale from a distance because when i got down out of that tree (in record time I might ad) he was a touch surprised to learn he was like a 2nd grader standing next to a now very angry ME.
My exchange sort of went like this......(he actually didn't say a word)
"You bleepity, bleepin' bleephead, I am 3 seconds from bleepity bleepin your bleep right here" (You can probably figure out how the rest of that conversation went for the next full minute.

)
I hope the statute of limitations is up on that one ......LOL ( I should probably go look up the definition of "Terroristic Threats"

)
Good luck with that one, and I wouldn't back off just because of in-breeding and fear of retailiation. People like that NEED to be put in their place or they will just make your life miserable anyway.