That is kinda how it is in Pine county where I hunt. Lots of dear, lots of spikes or 4 pointers, but the big guys don't show up too much. The big ones are out there, that we know for certain, but they are big because they are smart and only move at night. Get a couple trail cameras w/ mineral or salt licks.
We have got about 60 differentpics of a real nice 10 pointer the last 2 summers, but only 1 pic was during day light, and that was at 6:30 AM in July..
They are out there, just not as numerous as other areas.