You don't say whether you use a release or not but assuming that you do I would check the adjustment of the prongs. You may need to open them up a little bit, or check that they are rotated/positioned both the same. You should not be having that problem.
If you shoot fingers/tab you should use a plunger type or one that securely holds the arrow in place to alow for the string rotation that occurs during the draw.

"Hunt smart, know your target and beyond"