From your description it sounds like you're anticipating the shot/release and perhaps moving off target. It's called "target panic" and can cause flinching, which makes you miss the shot. Often by a good distance.
It's all about concentrating, and doing evrything EXACTLY the same way EVERY time! Also, you might try "floating" your pin over the target and releasing just as you cover the center of your target. Hope this helps.