You might try changing the nipple. Most times when one of my percussion guns goes from good accuracy to less than good with the same load, it's because the nipple flash hole has opened up. It happens pretty fast if you've been shooting conicals from the gun.
Or, perhaps you're losing concentration after five shots.