I hear this all the time. In the military we don't carry on fire we train deactivation and activation of the safety to muscle memory. It is literally a function of drawing our weapon system. It takes no more time to draw and discharge the firearm accurately with or without the safety on. Not all autos have an external safety, but there are plenty of options that do.

My question to you is are you carrying your revolver on an empty cylinder, because if you aren't and you are rocking a double action you are locked and cocked!