Believe it or not, I did it just a couple years ago... quit probably one MINUTE too soon -- and it cost me a solid 140-class buck.
I was on a field edge overlooking a bean field, and I couldn't see into the woods anymore -- but could see just fine out into the beans. I thought "What the heck, nothing's showed in three hours" and climbed down. When I reached the base of my tree, a big doe popped out with a perfect main-frame 10 folllowing her at 37 yards, and I could see them perfectly in the field. I made it 3/4 of the way to full draw when a trailing deer blew at me and everything scattered.
I had to call Matt / PA and he spent the next 20 minutes talking me off the ledge..