That's what is all about. I hate to say it but sometimes deer are smarter than people. The hunt, trying to outsmart the deer on his terms is what I find so exciting. Think of it this way, if you would have stayed in your stand and the deer went the other way, you may not have seen them at all. At least you know they are there and it shouldn't be hard to stay until after dark knowing they could walk out of the woods at any moment. Good luck!