You got a kill permit and permission to hunt for a reason. I would say fulfill your part of the agreement and thin the herd out to the best of your ability. Otherwise next year someone else will be asking the same question about the same property. The landowner is allowing you to hunt so that he will lose less money. I am sure he can find somebody else more willing to help him out in his wishes.