I take mine, it's on vibrate. I've had it go off when deer were directly under me and they paid it no mind. Turkeys are a different subject. I had a flock underme once and the cell went off on vibrate and they exploded outta there. I couldn't believe their reaction. I leave it on so I can be reached if need be, but I hardly ever pull it out to make a call.
It's great to have when I'm out alone and happen to hit one. I can call down the house (or camp if were there), and have my Dad and a brother or two be at my stand in a matter of minutes, ready to trail or drag. It's great at camp in that regard that I can have someone bring the deer cart down to meet me, not to mention the emergency thing. I see no problem carrying it. I'm not gonna talk anything but "hunting" if I do use it.
The memo idea sounds good too.