I did the same thing with the grips off my 1851 Navy. Couldn't understand why I couldn't get that one spot stripped and looking like the rest of the grip.
Like you, luckily, I stopped before I went too far.