So have I for many-many years and I don't have this problem at all. Never have.

I do run 2 wet patches down and then 2 dry before loading. Perhaps I'm getting it all out...

I'm not sure what the root problem is. I know guns will do it from time to time though. You could always shoot BH and then leaving it 'dirty' wouldn't be as big of a deal.