The more breeding a buck does the faster his testosterone will fall, and therefore he'll lose his antlers quicker.
I ran an archery check station for a number of years here in IL and part of that job was checking in kills from a late anterless pistol season. Unfortunately I checked in more than one big buck minus his antlers. It was a Shame!
Dan