Greg, I think that both sides are right here.
I think that hickory nuts would be very far down on the list of deers favorite foods!
I am sure that they would eat them if they were hungry enough though!
I once saw a list of East Texas deer foods, pine and yo-pon where on the list of deer foods. I think that the deer would be VERY hungry before they decided to eat either one of those foods!
So, while the deer may eat foods like hickory nuts, you would be wasting your time trying to hunt hickory areas, if there are better food groups available!