I usually hit it pretty hard the first one or two raps, and then see if the bullet has moved, and how much. Once the bullet starts moveing, i use light taps untill it's out, with no or nearly no damage at all.

After a while you will get a feel for it!!

Drilling Man