I feel your pain man! Thats just part of the rush of bow hunting!
Bow hunting will make you a better all-around hunter! You have to have everything right to get a shot with a bow.
Two years ago I drew back, held for a long time, and then had to slowly let off of my draw. Drawing back pinches my nock, so if I don' t shoot I have to re-nock my arrow. In the excitement of the moment, I forgot to renock and had another deer come in, when I drew back the second time, my arrow just fell straight down in front of my stand! It didn' t spook the deer much, but I had to sit down to reach my quwiver, I got another arrow out and was able to get it nocked, but by the time I was ready to draw thw deer had moved out of range!
Frustrating, yes! But I wouldn' t trade the challenge and rush of bow hunting for anything else!