If you wrote it correctly your trying to move the SIGHT to correct the tear?

You can take the sight OFF of the bow for now if you like.
If you meant to write that your moving the rest, then I would think your torquing the bow on the shots where the tear got bigger, but no adjustment was made.

Maybe you should look to the spine of the arrow as a possible culprit. Try a ligher or heavier fieldpoint to stiffen or weaken the spine and see if that helps.