Yep, ramrods do that in muzzleloading. Very short very fast short strokes when swabbing out the bore. And use some sort of fluid like No. 13 TC cleaner. It just needs broke in a tad I figure. Also, AJ is right about the patches. Had simular issues with cheap Bass Pro patches. I started buying T/C patches and cut the Bass Pro in half.

Also, do not swab out the barrel with the brush with the breech plug in. You don't want the pull the brush out of the barrel without pushing all the way thru the barrel. The brissles bind up and can pit the bore.