First and foremost, the entire point of dropaway rests is to eliminate ALL fletching contact. So, yes, I'd be obsessing about any fletching contact. Regardless of what kind of holes I'm punching in a sheet of paper, regardless of what kind of accuracy I'm getting when standing flat footed in front of a target butt. Maybe it's good when you're using your very best form, standing on solid ground, shooting level with the target, but what's your accuracy going to be like when you're 20-30 feet up on the side of a tree at the moment of truth?

I hate you're having problems this close to opening day, but I'd hate even worse to hear you wounded and lost an animal because you went hunting with malfunctioning gear. If you're determined to hunt Saturday then, at the very least, use the arrows that are NOT getting contact.

I'd still recommend swapping out to a standard rest and at least seeing if it helps. Good luck.