Do you use a peep sight? I would think even a slight variation in anchor point could cause accuracy problems as you described, even though the anchor feels the same.