Man That odes suck. but as others have said. if he doesn't hunt and is in possesion of the deer or was in possesion of the deer(as we know he was since he didn't let you get it) then there is a legal matter there for the game warden.
of course remember that any action could have a worse reaction to your hunting abilities on that land.