I have two answers for you.

If this were well in advance of the season, moleskin would probably be a good idea. It completely silences the sound generated by the arrw sliding across the rest. I used it for many years.

However, since the season has likely begun nearly everywhere, you probably aren't interested in re-tuning everything. It WILL slightly change a few things.

The next best choice is waxing/polishing the arrow rest and/or the arrows. Several coats on the arrows or the rest or both will also take care of the sound without the need to re-tune. You'll want to do this at a point where you can allow several days of "airing out" to take place before going hunting again. The wax smell will linger a few days. Just don't do what I did -- I had put my last coat of polish on my arrow rest and went back inside to give it time to dry, fully intending to remove it the next day. I was IN THE WOODS, HUNTING when I noticed it still there!!![:@] Didn't seem to matter to much though, I killed a real nice doe after I wiped it down!