I always take it off. It's too bulky. I end up hitting my arrows on every limb, branch, and on my stand. If I leave it on, I can't hang my bow on the tree the way I like. And if it's on, I also can't rest it on my lap. And it throws off my bows balance, affecting accuracy.

The only reason I'd keep it on is for spot and stalk, but I rarely do that.