For me, it all depends on what you're focusing on. If I can see a deer coming, and I'm thinking to myself 'oh, he's about to come from behind that tree!' 'he's about to get within shot distance!' I'm toast. A complete, shaking mess.
What I do instead is after I see it, I almost try to forget what I'm doing. I'm conscious of where the deer is, but I'm focusing on getting into position quietly and slowly, breathing slow and deep, coming to full draw, and picking out that perfect spot behind his shoulder. By the time I let the arrow go, I'm thinking - hey! That's a buck! And the shakes get to me again. It's fun.