I agree with the others that he's not treating you like a friend should.
I do think there are a couple of things you might consider though.
If you are going to cut him off this year that might be a little harsh. I can imagine having my license bought, my plans made and my hopes up only to be told I can not hunt - almost at the last minute.
That would be a crushing blow and may make him vindictive.
If you two already have your plans made it might make his selfishness a little more tolerable if you know this is his last hunt with you and you tell him AFTER this hunt that next year he won't get to go.
Another thing that comes to mind is the deer plot.
If he has a tractor, plow and disc or tiller and is willing to use it on the plot, that is not a thing to be taken for granted.
If that is the case you might tell him he can hunt if he does the plot but you two are going to swap stand locations. And mean it!
If he has no equipment it's a different story.
Ultimately it is all about standing up for yourself which reading between the lines it doesn't sound like you've done enough of with him.