If you're killing them....the answer's pretty easy.
Who is killing their areas "top end" bucks on a regular basis??? No one I have ever met.... Well, I know of one some what local guy who has killed two top end bucks over the past 8 or so years.... But that is it.
I think you are misunderstanding the difference between a nice buck for their area and a top end buck..... Lot's of people shoot nice bucks for their area on a regular / semi regular basis, not so on top end whitetails.