Hey Wayne,
I finally figured this out last year and didn't suffer as in previous years. True, the layering is really important and nothing is better than good headgear. You guys might think this is a bit extreme, but after I get to my stand (usually a mile-plus walk) I put on a new base layer wicking shirt under everything, and put the other base layer in my pack, since there is moisture in it. I also remove the pair of socks I wore in and then put on a fresh combination of wool and cotton socks over the 1200gram insulated boots. That gives me some time to cool down from the hike and removes most all of the moisture from my clothes. When temps are in the teens and 20's I bring the hand muff thingy and pack a few handwarmers. I think this year for those real cold days I'll try some of those back warmer pads since my kidney area seems to be the problem area. It's great when you can get out and not have to worry about shaking uncontrollably from the cold. The buck fever is bad enough.