Sounds like there is some sort of tuning, fletch contact, arrow tuning or arrow spine problem. If the spine is correct and the arrows are square and spin test OK you may have a tuning issue where you need to move the rest to get your field points and broadheads hitting in the same place then move the site.

Do a search on broadhead tuning.