Right it does take deer to aclamate to a new crop, but clover usally is not a new thing to deer anywhere. They have seen it wether in the wild or in hay fields. With the little details you have given us heres what I believe. Its lacking better nutritional value than what is around or it recieved to much pressure and the deer are staying clear of that area. Try fertilizing it and add more lime to next year, even add more fertilizer right before the season.