I've been thinkin it over and over. It kinda reminds me of something that happened to me about 7 years ago when I was rifle hunting in kentucky. I was walking up a jeep trail when I saw what still is probably the biggest deer I've ever had a chance at. Probably would have scored in the 170s. He was maybe 40 yards away. Clear shot. Front quartering. I've made kills like that maybe 10 plus times since and at farther ranges. I raised handi rifle and tried to center him in my scope. The problem was that at the angle I was standing the sun was creating glare through the scope. I tried to reposition my self so the sun wasn't a problem. The deer just stood there but I couldn't get what I would consider a decent shot at the deer so I passed rather than shoot and injure the deer. If I had the decision to make all over again, I would have made the same decision.

My point is that you made the right decision not to shoot if you didn't think that you had a 100% or even 80-90% chance of killing the buck. Don't worry about hunting 3 years and not getting one. Deer hunting is like anything else. If you put you're time then eventually you're efforts will pay off. Good luck and good hunting.