I tend to not play well with others, so I'd probably ignore him unless he did more than talk. I would definitely know where the property line were though. It's been my experience that the people who try to circumvent whats right, either legally or morally, are the first one to call the law on someone else.