Most of the time. I carry either a Colt Python, 6", in .357 Magnum, or a S&W Model 60 .38 Special, with a 3" barrel. Yes, they have left the holster in the past, generally as "signalling devices," to start drives, before we all got radios.

One of the guys in my camp carries a .45 Auto while deer hunting (it's a full-time carry weapon), and another carries a .22 LR semiauto at times while deer hunting. All three of us have carry permits for New York.