Could be the rest, are your fletches clearing? Put talc on the vane tips and see if it leave marks anywhere on your bow/rest.

Another high possibility is you're adding torque on the bow during the shot. Try shooting open handed with a wrist sling if you're not already.