amen to that XC!!! 20 degrees this time of year is a heat wave.
I dont stand hunt much anymore. Being I am in Alaska most of hunting is spot and stalk.
I did however go home to Mn last year to do some whitie hunting. My cloths, I prefer polar fleece also, wearing a arctic weight set. My long undies are the military weight poly pros with a duofold long sleeve t shirt. Socks are also poly pro, if need be a nylon liner. Boots, just depends on the hunt. The wolverine 800 gram books are WARM! BUt then so are my -100 sorels lol. WEAR A STOCKING CAP!!! Also the rag wool flip top gloves, if your fingers are of the cold type, wear a pair of thin poly liners underneath (its what I wear in -30 or colder, or when my cloths are wet and I need to conserve heat!).
I do need to add a couple things to my set up. One is a wind blocker either outer garment in fleeze, or the belas wool windblocking shirts. I HIGHLY recommend wearing a wind blocker set up of any kind and the best is having it on the outside, not close to your body!
Growing up in Mn when we still had winters, and now Alaska, bulky cloths is something you have to learn with! I wear an arm guard no matter what. Its not really there to protect my forearm as I very rarely hit it. Its to keep my cloths out of the way! In winter I want to start wearing an white chest protector to keep my baggy whites off my bowstring also! It might be worth looking into. I am sure after a few hunts you'll be used to it and its better to take the precaution then to rip a shirt off shooting at mr huge and then cuss yourself till next year and blame your cloths!
One last thing, you could try those sleeping bag looking suits. I have heard nothing but good about them. My only complaint would be I'd want the outside lined with polar fleece <img src=icon_smile_big.gif border=0 align=middle>!