I'd politely ask him one more time. If he says no, I'd call the game warden. He'd most likely tell you to go get your deer. If he said no, I'd wait till about 2 am and jump the fence and find the deer.