I use the same system and it works great. As previously stated when it gets cold i wear the vest under my coat and feed the strap out the back of the neck of the coat. For climbing up and down a ladder stand i would get a caribiner and hook it through the strap on the vest and as you go up just hook it on the next rung of the ladder and adjust as you go. Good luck.

hope this helps
Tom