The answer to that is NO. One aspect of a true QDM program would be to let those deer walk. In your situation, it's tough. It's really up to you if you want to try, but you need to have everyone in agreement, or it will never even have a chance to work.

Where I live, we have 100 acres and won't shoot anything that's not a wall hanger. All the folks around don't pass em up, but I still do. I'd rather shoot a doe than a small buck. I've also done other aspects of a QDM plan, (food, cover, etc) and it is working fairly well, even though we have a limited amount of property.