If you have to ask yourself whether or not you should have taken the shot, then you did the right thing by waiting. Far better to let him walk away than to make a bad shot and not be able to recover the animal. Or possibly cause a slow lingering death[X(] and never have the opportunity to see him again.
If you didn' t disturb the area too bad, put out some esterus scent and hope for the best!