I think you are considering "fawns" young deer with spots.
I'm not sure, but maybe you don't realize, that most fawns are born in the spring and by the time hunting season arrives in the fall, they will be 5 or 6 months old and lose their spots. There are a few that were born late and may still have spots, however.
Hunting seasons are during the fall.
Any button buck is actually a fawn from the previous spring.
I just wanted to clear that up. if you didn't know.
Yes, some of us shoots " fawns", and yes, they are better eating.
Here is a fawn.