The first layer is critical if you work up a sweat walking in to your stand. You need a layer that will wick away moisture. You can get some good stuff at ski shops.

I also find that a neck gator and some of the disposable hand warmers help. Getting cold I'm convinced is part mental, the warmth of your breath into the neck gator and hand warmers helps!!