I normally leave mine where it is. Its comforable there, plus it also helps to keep my muscles conditioned for hunting season when it gets harder to pull back in the cold.

Some people will back it off a hair before season. Doesnt make sense to me, so I let well enough alone.
Besides, then you will have to retune a bit for the lower weight.