My wife always asks me that. I tell her I diddn't go fishing, but I didn't kill anything either (which is usually the case!)but it is annoying.
I just do with the flow!