I've seen the same thing. My uncle took what he thought was a doe last week and it turns out it was a small buck that had dropped his horns already.