Wind,
I think you have hit the top 3-4 ways to distingush a BB from a Doe.

Look at the head. Doe = dome/round/bowl shape with longer jaw bone.

BB/buck fawn = flatter head with shorter stubby jaw.

BB may very well travel alone - or - be the 1st one to pop his dumb head out of the woods or bush(2 red flags).
He's the Dumbest Chunk of the bunch = probable BB.
We have Jan season where deer start to yard up.BB's and Buck Fawns can be any where in bunch but usually the 1st one on the scene.
I've seen some pretty big BB's in Jan.

Matter of fact I shot one about 5 yrs ago in late Jan because I didn't think a BB could so big. Wrong!! It was the 1st and biggest to walk out of woods.Screwed up! It takes patience and a little time to make the call but that ole BB or spike can be a nice deer in a couple years.