Jeramy thats why I like a hat like the " Plantation" it has a shorter brim than a full on cowboy hat. I have no problem drawing with my hat, but I have a boonie that has a full cowboy hat type brim (I believe most are 3-3.5" brims) and I can only use it for gunhunting.

Good luck,
RA