If he's only 2 1/2 years onld he still need time to reach his potential. He'll also need quality food sources to promote growth.

Ultimately why you want to harvest him should answer your questions. Will you be happy takeing him? if so go ahead. Are you trying to protect the area gene pool and cull out subordinant bucks? Let him go and give him another year and I'm sure you'll be plesantly supprised.