If they like the area and weren' t just passing through, they should be back. I think a day or two would be fine to wait. They do tend to wander quite a bit (at least where I hunt), so they may move on anyway, not because they spooked, just because they want to. Good luck