I'm going to come down on the oposite side. If it's open hunt it. If he comes late as is normal, leave. I don't have this problem with hunting other peoples stand because they are always to low for the area. I have many of times climb theirs only to attach my climber and go up higher. Never have I had a problem and if it was I wouldn't care. There is plenty of woods to hunt. I have no problem moving. On the other hand when I pick a spot for the evening I'm hunting that area.