While that may help in some situations, generally, you want the arrow rest to drop as soon as possible. The idea behind a drop away rest is NOT just fletching clearance, but to NOT touch the arrow after it starts moving.
Basically, you want to rest to " top out" just as you start to roll over into the valley.
Basically, I would try to raise the rest SLIGHTLY to fix the problem. Why you are getting a 6-7" turn to the left in the last 15 feet when shooting 50 yards is beyond me at the moment.