I've been in a similar situation and I not so kindly told the guy to mind his business/property or I would let my young cousin loose with a hand full of doe tags and instructions to kill every deer he can (2 deer a day). I told him it didn't matter to me, as I had plenty of other places to hunt. He quit aggravating me too...