Yeah, yelling at them wouldn't have been my first choice. Not sure there really is a good way to push a deer off. Rather than yell possibly blow simulating a deer. If your convincing enough they'd go assuming it's another deer but not know why. Or simply get down as quiet as possible and hope, if you bust them it still might be better than yelling.
Congratulations on the fun hunt tho. Close...