First make sure that your shafts are clean. A light sanding with 400 grit sandpaper and run under water then wipe with alcohol.

Some glues are just weak also. Goat tuff is super strong but it' s a bit pricey. I use plane old super glue gel and you couldn' t pull them off with pliers.