Well it all depends on how much he was spooked and if the arrow spooked him or he actually saw YOU. If he actually saw you, I would move my stand some as he may avoid that particular site.
And, I know exactly the reason that you missed. If you were looking at his rack long and close enough to know he had 11 points, then you weren't concentrating on your shot and shot placement enough! You let the size of his rack eat you up. Not being smart, speaking from experience