If you're hunting to have fun and you guys have fun together then I say try to make it work BUT just flat out tell him that you will not hunt on land you dont have permission to be on. (first and foremost)

If you're hunting because you're serious about it and you don't want people messing you up than I think it's time you went at it solo.

Good luck----that's gonna be a tough decision.