Ezbagr
It sounds like you have the magnetic version plug in your gun. That magnet is a fairly strong in that plug as I just now found out, they hold the primer in very tightly.
Also the primer does not go all the way into the primer pocket.
There is another plug available from Knight that does not have the magnet in it and is possiblly cleaner than the one you have...
Hope this helps....