I once did much the same as you. However, considering the heights I now normally go to and my weight, I use the harness the moment I stop into the treestand at the base until the moment I get back down. There is just too much that can go wrong and can be avoided with the use of a good safety restraint system.

Speaking of which, I do not know if you guys know of the new Summit "harness" out there but I just picked one up and it is excellent. I will have to do a new product review of it shortly.