Yes, it does to me. Let's face it, in most cases a young deer is much easier to get the drop on than a mature deer. I associate big numbers with older deer and a bigger accomplishment.
Are you telling me that if all deer had the same rack(say,the rack of a 1/2 year old 4 pointer), you would hunt as much as you do?
I wouldn't. I would hunt, but probably would not be obsessed with it.