I agree with the others. Try talking to the guy or leave a note and work incrementally from there. You don't have to use the nuclear option (calling the game warden) if he gets the hint...maybe he's not even aware of the baiting rules.