Yeah - I' ve noticed some degradation in the intensity of the black - however there is little in nature that is " Pure Black" . I don' t think that it matters.
BTW - Why would you NOT wash the headcover? Most of your heat/water vapor departs through your head. That heat/vapor is taking scents and smells with it and the smells are being deposited on your headcover.[

]