The term could be used in any of those situations. Usually when I say I missed one I mean I was close to it but had no shot. The term does seem to imply shooting, but many people I know use it differently.