There is an article here that is an interview with Ron Dahlitz (founder of Buffalo Bullets), he discusses lapping muzzle loaders (it's about 3/4 of the way into the interview). He advises against it, but recommends using steel wool to smooth out tooling marks. I haven't done this...