It all depends on the deer. You never know when he will come back. Most of spooked deer do, but I guess there are some that do not depending on how uncomfortable they feel. Maybe you'll get lucky and see him again tommorow.

GOOD LUCK