Just tell them that your stomach was upset and that you had no choice but to take care of business right under your stand. That should keep them away for the season giving you enough time to work out a long term plan.
But seriously I know what you mean. Three of us hunted a large piece of property which had more than enough room to hang multiple stand sites for everyone. Then we got kicked off and went to a place about the same size as yours. And with only 80 acres there are going to be a couple of hotspots and the rest could be hit and miss (at least that is what we ran into). It almost became a race to see who could leave work the earliest and hang their stand before anyone else, which wasn't good for the family/friendship. We ended up talking and the end result was doing a "blind draw" for choice on which area we hunted. It was a real ugly situation for a while.

--Man who fish in other man's well often catch crabs--