I agree that it could be hand torque. Has the arrow flight gotten better with the whisker biscuit? The reason I ask is because that rest would make your flight worse with hand torque issues!
My suggestion is to buy a good drop away rest. Paper tune it and then go from there. Once paper tuned, your arrow flight should be pretty good.
You can paper tune the whisker bisket also.