It may be a few different things, MO.

It may be your string nock, your brace height or your release. The first thing is paper tuning the arrow. See what the arrow is doing. If your nock is set in the wrong position, it will cause the arrow to kick up and down. If your brace height is too low or high, it will cause the arrow to kick left/right. If it is a combination of the two, the arrow corkscrews. Also, check to see if you arrow nocks are too tight on the string. They shouldn't be too hard to nock off if you tap the string.

The last thing to work on is your release. A glove or tab is only there to protect your fingers. If you have a proper release it should make no difference in arrow flight. I alway's rub in a leather conditioner into my gloves. It keeps them flexible.