I'd guess that it's the heavy jacket causing your form to deviate a bit more than it is your thin glove but a glove will change your anchor point slightly as well as how your hand addresses the bow.