Sounds to me like you're getting buck fever and anticipating the shot.
I would suggest two things to help alleviate this challenge -
One, aim a little lower to offset the jump you're experiencing.
Two, calm yourself down before the shot and concentrate on form.
It's obvious to me that you care substantially about being a responsible hunter, wanting a well placed shot to get a fast kill.
Take an extra, very quiet breath, before releasing your arrow. IT may help keep yourself on the mark.