I'd try harder to get it out. At some point you'll have to when it wears out.

Too big a hole is as bad as too small a hole.