Yeah, thats the feeling many get and as you say sometimes the tables are turned and that is as it should be. When you put yourself in danger, be it hunting a large animal or riding a bull (which statistics show more dangerous than hunting) You will sometimes come out second.
As far as other hunting having a degree of averageness, thats a matter of opinion and for those who don't enjoy it by all means stay out of the way of those who do.
. I have hunted for nearly everything and enjoy it all. Hope everyone else does the same.