One thing to think about is, if you don't wear any sort of harness and besides thinking if you actually fell, think about the message you send to other hunters if you don't use a safety harness. Actions speak louder than words and just the sight of you using a harness may spread the message to someone else who really needs it.
Good luck,
iSnipe