Don't question yourself. If it was meant to be it would have happened. Sure he will be bigger next year. Could be a 10 point with more mass next year. If he makes it that is. I would say if you get another chance at him don't feel bad about taking him. If he is 20 inches better than your best buck go for it. Don't get caught up in all the got to wait for a big buck hype. Do what you want to do.

I have hunted for over 20 years and taken more deer/bucks than I can remember, some of my best hunts ended in little bucks or does. I would say if you want him, get him.