RE: What would you do?
If he crosses into your property to retrieve a deer he has taken, he can be arrested. If you have proof of him shooting and tracking a deer into your property, the police can arrest him for trespassing. I would put a trail cam hidden in front of his stand, and watch what he does.