Sounds something like an encounter I had with a nice eight point on my way to an evening stand this year.....This deer walked dead up on me at ten yards from behind right in the middle of an old logging road while i was spraying some cover scent on my boots. I was half way turned around when he snorted and scared the crap out of me.....To make a long story short, I ended up getting a 35 yard shot at the deer. My arrow hit a pine limb the size of my pinky and deflected. I had been watching this guy in that area everyday for over a week.......so as you could imagine i was very upset to say the least. I thought for sure that he would never come back. I pulled myself together and got in my stand and 30 minutes later he walked by at about 50 yards!! I finally settled down again and 45 min later he came by yet again running a doe!!! I've yet to get another shot, but to this day I'm still after him..... That said, I wouldnt sweat it a bit, just stay at it!! Good Luck