There are several good choices. Cotton being probably one of the worst. Different clothing manufactures call material different things, but I'll generalize for simplicity. My Choices are as follows:
1. Wolfskin, this stuff is nothing short of awesome. I have 2 outfits. Uninsulated and insulated, one is 6 plus years old and has been washed countless times but yet shows no signs of fading.
2. Saddle cloth
3. Fleece, only thing I hate about fleece are the stick tites, and burrs.
There are others, and mainly stay away from the cheapo cotton camo. It has always faded on me very quickly.

The Wolfskin has been the best I've used.

Dan