I wouldn't count on it being shot. I've seen numerous deer with racks broken off, some before the season even opens.
Here's one that knocked off pretty much his entire right side on my place before he was even out of velvet. His nickname is Lefty.
Here's his twin brother, Righty!
Both of those pictures were taken before rifle season opened in Texas.
The more mature bucks you have around, the higher the likelyhood that some of them are going to get some antler points (or their entire main beams) knocked off.