get a piece of metal rod that will slide easily down the inside of the shaft (a drill bit will work), and use a whipping motion to drive it against the insert. A few trys should pop the insert out.