David Morris devoted a chapter in one of his books (Hunting Trophy Whitetails)to what IL-Cornfed is describing.Secretive Super bucks.A buck more concerned with survival than breeding,an ultra extreme timid animal who very likely isn't the dominant buck in the area because they are also averse to fighting.
Obviously a genetic phenomenon.Or an emotionally scarred animal,a just miss sent them in to a super reclusive existence.