There's actually no such thing as a "buck tag" in most places, it's antler or antlerless for this very reason, plus occasionally a doe will have antlers
Do you have a picture of the head? The head looks different when they fall off vs when they break. The antlers actually do slightly into the head, so if it broke, it should be easy to tell.