I had something like this happen my first time in the woods with the exception that the guy came over and yelled at me for being to close to him. I have never stept foot back onto public land to this date.
I wasn't on public land...in fact I was on Federal land..Eglin AFB, FL. They had a small patch of woods at the end of the runway that was for archery hunters only. I saw the guys truck when I walked out and I almost took down the tag number but I didn't. Needless to say I never saw his truck again. I ended up hunting a friends permanent stand up a HUGE oak tree in the same general area. I took my first scrub oak from there. I have it mounted as my first bow kill.
Happy Hunting
Reid