Statistically the only way you can be running out of big bucks is by the hunting population in your area shooting them before they get to be big and by harvesting more bucks than doe.
I just stopped by the locker the other day and saw a pile of deer to be processed and several 1 1/2 and 2 1/2 y/o bucks were in the pile with the hunters not even wanting the antlers. We all have the right to choose our harvest but one thing is for certain, thebucks won't get bigger by shooting them young.