I have gotten the same light rust looking effect when cleaning blued barrels. I just dry patch it until I get a clean patch and then the next patch is my oil patch. Seems to work for me. But I know exactly what you are seeing on that patch and it does make one mad.