AS has been stated, with some practice, you can get a climber off your back, attached to a tree, and climb pretty quietly. I've also had deer come by as I was climbing, and not even notice me, as well as having them come by very shortly after I got situated. Coming down is just as easy and quick. I've got an old Summit viper that still works good.
As far as cutting tree limbs, I use the same trees on our farm from season to season, and usually the tree limbs don't grow quick enough that they need cut more than the first time I climb a particular tree.