I have a pretty long walk to my stand in really hilly country and I wear the base layer and then pack my winter gear in. I know it can be a burdon but I have found this to be the best way for me. I also take my time getting to the stand. If I have to leave earlier then so be it. I take lots of breaks when walking to my stand to help me keep from sweating.

Also have you ever thought of a sled or anything? you can just pack your stand and winter gear on the sled and drag it in. It will make some noise but shouldn't be to bad if you take your time.