Don't concern yourself with the 1 1/2 year olds that your neighbor shoots but stay focused on the number of the 2 1/2 - 3 1/2 year old bucks that are nice respectable deer but not quite "trophy status" that YOU pass up.
I am a trophy hunter until the last couple of weeks of the season. If I have not filled my only buck tag yet, I will gladly fill it with the smallest racked 1 1/2 year old that provides such an opportunity. I will continue however, to pass up the respectable 2 1/2 -3 1/2 year olds that may only be one year away from truly being a trophy that most people shoot and then brag about how their buck ALMOST scored book.