I wouldn't be so worked up about it. In our state it's legal to retrieve a wounded deer without asking permission. I don't see the problem. If the deer are on your property they're probably on his. There's nothing illegal about setting up close to the line. I have done so. I don't shoot deer on the other property and don't think that you should worry unless he does. I like to hang my stands on the backside of trees by the way and that might be what that guy was doing. I'm not saying anything else because I'm sick of getting caught up in the dang arguments.