A kisser button would really help in this situation.

It also sounds like you might be losing focus. Try to slow everything down when you shoot. Get into a routine. Focus on drawing back your bow, then focus on a good solid anchor, etc, etc.

Take slow breaths and do not punch the trigger.

Best of luck!