I would avoid the guy as much as possible. Don't give him any information, don't tell him what you saw, shot, etc. He can't dictate what you do on your land. I have a similar neighbor who only gun hunts. The last two years he likes to target practice during the rut while I'm bowhunting. Funny how he likes to shoot from first light until about 9am and then picks it up again during the last hour and half of the day. You can't reason with morons. It just brings you down to their level. Good luck.