How much land does he have? Are there big deer on there? Maybe you should make friends with him!
I know hes in the wrong... But it would be nice to see one of these situations end peacefully and friendly. Youre the better man if youre not doing the same thing he does.