I was taught that lesson many years ago.. when you don't have a rifle, the deer will come out. Now I even take a rifle to the outhouse.
I actually once knew a fellow (we called him Fast Eddie)that used the outhouse as a deer blind. No kidding. He was a very old fellow, and he took one of them heater buddies in there with him. And he'd sit in there for hours, looking out the side window. Strange thing is, he used to get deer (he'd bait with corn about 40 yards out the side of thing which is perfectly legal). We used to tease him, but he just laughed. He said he lost his sense of smell a long time ago so the stink didn't bother him, in winter everything is froze solid and don't really stink anyway, the seat was comfortable, it was warm, and with his bowels he was not taking any chances...