Even though you spooked him he didn't leave the county. I would suggest moving your stand a bit so he doesn't come checking your tree next time he's in the area.