Too bad you didn't get a shot off. As long as the does keep hanging around the buck will surely come back. Not sure who scared who the most. I'll bet the buck has no idea who or what you are. From your description of events. The buck probably had his head to the ground following the doe scent. Keep us posted!!
Good Luck!