What kind of oak are you in? If you're in a red oak, and there's a white oak going crazy somewhere, they may be there. Hard to say. There may just be another food source they're hitting now while it's there and will get the acorns next. If it's still pretty green in the woods, there's a lot of food for them.
My dad always answers the question: Where are the deer?.......They're in the woods.