There is usually a time you are less than ideally attached. For me, it is usually when dressing in my stand, but I'm careful. I might start wearing my HSS in the middle, but it hurts my ability to wear a hood, so I prefer it on the outside.

With a ladder, it is when you are on the ladder, I guess you could clip to the rungs, but the really aren't designed to support a fall. On a stand which you climb up tree steps, ususally the step to the stand is unsecured, but I suppose you could put steps above the stand so you can secure your strap/rope above the stand before stepping in.

Climber's are best because you could be attached to the tree the whole time. Trouble is, you can't be dressed for the long sit while you walk in or climb the tree, so you end up un harnessing in the tree to get clothes on.

One solution might be to setup in a real climbing harness. It would be a seat harness. You could add an optional chest harness. Then, when putting extra layers on, you would still be connected to the seat harness. I'm not doing this yet, but who knows, I might!