It's all about what makes you comfortable. If shooting a pregnant doe would bother you, don't shoot a mature doe. A "small" doe at this point in the year wouldn't be that small, and would be tasty and tender, but if that wouldn't make you happy, don't shoot.

If pulling the trigger results in akill you aren't proud enough to show off to friends, then you shouldn't pull the trigger.