Man that would have frustrated the crap out of me!
Well... I would have staid completely still to first see what the deer intentions were i.e. move in my direction, stay still, or move off.
Also to give it a change to see if it does infact sence me/somthing. Once I was comfortable with the location, wind and the deers temperment I would more than like likey try to move in a little at a time or with in bow range.
I would use the call to assist but more than likely if it heard me and to keep in interested in the area at the moment.
Sounds alot easier than it really is. You may have not spooked the deer at all, may be there was a preditor you did see or smell?
Good luck