I have also been in the same situation. I watched a 195" buck 2 years ago, and a 180" last year. I had them downrange with my bow, but I didn't work out. They were shot opening day of Gun 1. It happens. Use that compassion to better yourself for next year! Eventually, you could be the one that everyone else is jealous about!
Also, a lot of guys that use the "If it's brown it's down" theory, probably don't archery hunt. Gun season is probably their only season, so they are happy with anything. They have the right to shoot whatever. Just like you have the right to shoot whatever deer you want.