Probably not a big deal. However, in the medical community there's a phenomenon known as "white coat syndrome" Basically the sight of a doctor makes you nervous, your blood pressure rises, etc. I get the same thing with LEO's, and I'm definitely a law abiding citizen. Nothing to hide. I'd imagine others feel the same way at times.