I feel your pain buddy....I had a pheasant hunter that was trespassing do the same thing to me years ago on a 120" 10 pointer.

The only difference was I went and chased the guy down and told him if I ever saw him again he would have a game warden to talk to and not me. After the fact I got to thinking that maybe I shouldn't have chased a trespasser down that was carrying a gun with only binoculars in my hand...oops.