Sabots, and patches make a huge difference...Now, are you cleaning, drying and lubing the barrel between each shot so the barrel is in the same condition each time you shoot???

In the muzzleloading world this makes a difference, you are not only handloading but with all the left over residue from the previous the barrel needs the same cleaning, lubing and drying procedure each time...