Hunter/gatherers had greater variety than the people who live mostly off of crops. They didn't get oranges from California in those days.
The varied diet was healthier than a largely grain diet. It is possible to have a vegetarian (farming) diet that is healthy but it takes a lot of education to keep you from being deficient in nutrients. One reason we are taller today is that modern diets, though agriculturally based, are much more varied than the diets even just 100 years ago.
We are taller than our recent ancestors but not much taller than the hunter/gatherers before.
Bob