You can ask him but dont expect him to oblige. Doin this may even cause tension or a rift between the two of you which may not be the best for either of you.Anyways,theres not much you are goin to be able to do about it if he wants to stay there. If it was me i would try to do something to get the deer to frequent another area on your property like a foodplot or sanctuary area.