just do it. if you can't be monetarily successful, your friends and family will look out for you. just quit your job, and start doing what you love.
but seriously, if you love it, become a guide, and when you're not guiding someone else, you can go hunting/fishing all you like. just be sure you're a descent guide.