If you never know where the arrow is going then you don't need to adjust the sight. All long as your hitting the target and not throwing arrows in the dirt you need to figure out why you are having fliers. Things to check proper draw length and weight, arrow spine for your setup, are you gripping the bow the same every time and not torquing it, using the same anchor point, fletching contact and after that a proper tune then move you sights to adjust for point of impact.

As you change one thing at a time you may need to adjust your sights to keep you in the area of the target so you don't loose any arrows.

There are probably other things that can cause the problem but this is where I usually start