An old worn nipple can be like that. But to be that loose don't sound right. Give the cap a little squeeze next time. Not so much to crush it, just to bow it. Then push them on. Or get a new nipple for the rifle. Like Muley said, I almost have to pry mine off sometimes.