Since it doesn't matter about the shaft piece around the old insert I would try using heat. You could try a heat shrink gun (blow dryer on multiple steroids LOL) or I would even give a torch a try. If you have an insert tool I would put that in, heat the shaft piece surrounding the insert and then grab it (shaft piece)with pliers and give it a twist. That may break the seal and then it should come right out.