If you've never seen a fawn with buttons so small as to be almost undetectable then you either havent seen many button bucks or your deer are far different than the long haired critters we have.
Who in the world would shoot if they couldn't make the distinction (and it mattered to them)? That's assinine.