Nothing to worry about, as long as you are not frequenting the place you spooked them they will be back, heck I have spooked deer during the season and they were back the next day, that doesn' t hold true all the time, but spooking them during the off season is no issue.