Someone may have already mentioned this??
As you mentioned the deer was obviously alerted by something/someone was in the tree...

You can see this as he trots off, from in front of you, to where he stopped and you shot at him.
My experience is that I would have aimed a few inches lower, knowing he will jump to bound away, by his body actions in the video.

Good luck!