Practice makes perfect.

I used to have the same problem when target shooting myself. Someone told me to take a deep breath and slowly exhale and pull the trigger while watching the bullet hit the target before pulling back from the scope. It takes practice, but you will find yourself hitting more accurate groups.
Hope this helps,
cahillnc