We experienced the same thing here, I wore my baselayers, a layer of fleece baselayers over that, and then my fleece jacket and pants with windblocker and I stayed very warm. I wore my sock liners with a thin pair of smart wool liners on top of them in mucks woody max boots. Never got cold feet either. I have a rivers west jacket and pants for when it gets wet and colder, If I wear all this and then my rivers west, I am good to around 10-15 degrees or so.

I have been looking into getting a medium weight wool shirt/pants. I'm thinking when it gets colder maybe it will be warm enough I can just wear baselayers, wool, then the rivers west jacket and pants.