Fleece is good ***outside*** a good moisture wicking layer. Don't think there's much difference in one type or the other. I bought some heavy weight silk last year from cabela's, I liked it. Funny thing though is it retains moisture for what seems a long time still I wasn't cold wearing it.
Heavy weight Poly Prop is good and I think better than the fleece also outside a good moisture wicking layer although it does a good job with moisture on it's own.
Fleece without the moisture wicking layer is like being in a swimming pool all day but it sounds like you already have had the fun of learning that.
That silk is something.