Most sights and bows do not have that problem. Are you sure you are not torquing the bow? Make sure you have as loose of hand grip as possible. If you use a wrist strap make sure it isn't tight. Also, make sure that your bow is centershot properly, you may want to start at a pro shop and center it for you as a good starting point. You also should make sure that you are releasing the arrow correctly, never punch. Other then that check for arrow clearence, and even perhaps cam lean.