You should just be able to back them out and the SHOULD turn off.

But don't get discouraged, we can put a man on the moon but can't make a good lighted nock. I tried Luminoks they failed on me pretty quick. I've made my own with mixed results. This Year I went with Tracer nocks, the first failed quickly and they replaced it, the next 3 have worked flawlessly thus far!