He'll be back. Big bucks (if that is what it was) have escape routes in their bedding areas for a reason. If every time a buck got spooked and left the area for good he would end up in the rain forest- know what I mean. I would definately give it a couple days rest though.