I really don't know if there is anything that you can do. I believe that one of the other guys is messing with you, maybe upset because you killed a buck, maybe trying to get you to pick up and move on and have the ground to himself. Either way, he is acting very childish.
If you get the land owner involved, everyone involved risks losing out and it is the wrong time of the year to be losing ground. I really don't think it would be all that helpful to talk to the other hunters, if he acting this childish I don't think you can reason with a man like that and all you really are doing is letting him know it bothers you (he wins).
My best advise would be to deal with the little problems, let it roll off your back. Next year either think about hunting this farm with a climbing stand, as one other poster mentioned, or looking for different ground in the off-season if it is that big of an issue.
Sorry that you are having to deal with this stuff! Show him by shooting an even bigger buck! Good luck!