Be assured DonkeyHodey that your shot ramrod now rests peacefully with the rod I and many others have sent to the Land of Flying Rods, never to be seen again. May they rest in peace.
If you're dry swabbing, after the swab tilt the bore toward the ground and slap the breech. Try it over a clean surface and most likely you will find flakes of fouling falling from the bore. I do that after three or four shots even when wiping the bore with alcohol between shots, and always have some debris fall from the bore.