If that's the case, it might be worth it to put a call into the DNR and see if they'd do a search. If he's been busted already, they know he's got a history of violating. Suspected untagged deer in the freezer would be grounds for a search if you had any sort of proof other than betting it's already in the freezer. Of course, that wouldn't do anything to help your situation, and would pretty much ensure you never get permission to track a deer onto his property. It's a tough situation to swallow, but I think your best bet is to let it go. I don't agree with those that recommend going in and getting it after dark, especially after you asked him. After getting busted himself, I'd be he's just chomping at the bit to get someone else busted as well. It's not worth it to risk the ticket and possible loss of hunting privileges depending on how hard they come down on you.

You did the right thing by backing out and asking him first, unfortunately this time it didn't work out. Maybe sometime in the future you can bust him on your land and get some proof. Karma has a way of working itself out.