Did he wind you? Does your rest make a scraping noise when you draw? 5 yards is danger close as far as a deers senses go. Are you up high enough? If you can do it without much fuss I' d try to sneak up a different tree somewhere in the hedgerow. At the minimum, give it a few days off.