If he is one of your few great friends, then I wouldnt block him off entirely. I think you past that point a couple years ago.

Like others have said, get the sole authority over hunting your Grandpa's land.

Next season set up some rules. Coordinate some dates that he is allowed to hunt there. If something comes up and you are going to be in town, you trump him and his date will be moved. Or better yet set up a second stand in order to film eachother hunting switching off morning/evening.
Set a bag limit. Give him a big buck or two smaller bucks and a couple does every year.
Make sure he understands the concept of "Leave no trace".
Go over trail cam pics together and try to make it a joint venture going into the season, so you two can have fun with it as friends should.

If he doesnt abide by the rules, he loses privies.

If he gives ya any lip, explain to him you are the one sharing here