I currently hunt with a scoped Ruger Redhawk .44mag and have harvested 2 bucks, one doe and a large boar with it. Happy with it- yes, but something did happen with it two seasons ago thatpushed me towards orderinag a Savage Striker in .308 to hopefully replace it as my primary hunting pistol. (hurry up Savage[8D])

What happened? Big buck (for my lease) walking 50 yards away. I pull the hammer back and it makes the "clink" of the double action setting the hammer back and the buck jerks his head my direction to see what the noise was. In the end it didn't matter as he's still on my wall, but I'm hoping easing the safety off the Savage will be a quiter ordeal than cycling the double action.
If the ruger was a single actionI could use the finger on the trigger while easing the hammer back quietly trick, but since it's a double action that's not an option ( I've tried it).

I doubt that slight noise would matter 98% of the time, it ALMOST mattered for me.