I suppose it depends on the circumstances. I am not a trophy hunter. I do not measure the success or quality of my hunt by points or dimensions of antlers. If I see a healthy doe, I take the healthy doe. If I have a combination tag and I want to take two deer, if I see a buck I'll take that, I don't particularly care how big his rack is, so long as he is legal. Now, if my hunting area has an abundance of deer and by waiting I have good reason to expect a bigger buck to come along, I might wait, or I might not wait -- shoot, get the hunt over.
I don't disparage people who hunt for or measure the success of their hunt by the rack of the deer they take. By the same token, I don't see why I should be disparaged when I do not take consideration of that physical parameter of the deer, other than to assure I'm legal.