I love to hunt and fish. I hunt multiple species and harvest what I can. Do I like a big rack, heck yes. In my neck of the woods the deer population is low so any 130 class and above is something special. Do I apply for doe permits, of course I do. The doe permit allows for holding back on the young bucks but increasing the odds that you can tag out before the end of the season.
The antlers are the reward for outfoxing an old buck. Maine laws do not allow baiting for deer so you need to work a bit harder to pattern deer and understand the variation in the mast crop from year to year.
Shoot them both and and be content with each.