Can you give more details such as type of arrow, helical or straight, type of rest, etc?

This will help to give you abetter answer. So far it sounds like fletch contact on a prong style rest with offset or helical vanes. Depending onthe rest & arrows I can give you some clear advice.