Never been told "no" but if I was told no like you were I would probably make sure karma caught up with him. I would certainly hope the land owner that lets me use his land would tell him he can no longer hunt the property.
If it happens again you might want to get the landowner over there to try and talk to him.