I have a couple of lehigh conversion plugs and so far using federal primers I have never had that happen. My factory mountaineer bare primer plug does that sometimes and I have to fire the spent primer and then it falls right out.
Hope it straightens out for you . It sure would be frustrating.