If a doe has a fawn or two, what is the impact of taking that doe?

By fawn, I mean born this year...so less than 1 yr old. My thought is to pass on these does, but I know folks that take them anyway. At this point, will loss of the doe have a negative impact on the youngsters, in terms of their survivability during winter?