I say, if it ain't broke don't fix it. Doe management is key to herd management. Say you were to which to taking no doe. Your area begins to get overpopulated; food/nutrition becomes less available; lees nutrition = smaller racks; etc. Like several others said, the deer are going to be moving in and out of your property regardless of what you do. If the permits are there to havest doe, harvest them. There will be plenty more to take their place, because doe make doe, too.