Think of it this way - you are still "only going to shoot a buck" .
IMHO there's nothing wrong with shooting a doe AND a buck. They both are legal (assuming you have a tag), some does need to be removed from the herd, and they taste Grrrreat!
Good Luck!