RE: how mad would you be
This whole QDM thing is a crock of crap anyway, IMHO. But, we're not here to debate that, so we won't go there.
In your situation, I would be upset, but certainly not at the hunter that shot the deer. The only way you are going to make any serious difference is if you own hundreds of acres, if not thousands, and have total control over what deer are shot and which ones are let to live.
In MO, we have antler point restrictions, which, BTW, I don't agree with either, but I have had to let several bucks walk this year and last that most likely I will never see again. You only get so many chances at mature bucks, shoot, even young bucks, and around here those chances don't come frequently enough for me to allow them to walk. But, rules are the rules, and I follow them.
If I was on bordering property to you, and a legal buck presented a great shot, no offense, but I am shooting. I am just not proficient enough in my deer hunting career to not take those shots when I get them. Someday I may feel differently, but for now......I am included in the "meat hunter" category, and proud of it.