If you can't let your bow down in a controled manner than it sounds like your pulling too much weight. How much are you pulling?? It's not speed it's accuracy and control.
Just tonight (my 65th sit of the year) I realized how NICE it is to shoot my bow at 60#'s (for the very reason cited in this thread). I drew my bow near last light (to see if I could still center my pin housing if a deer came in) and just marveled at how easy it is to let down with this poundage.
I can put my intended target inside my pin housing and draw it straight back....never letting it come out of the housing. I can let down doing the same thing.
I don't see me going back up in #'s.