I think it men in general, not just hunters. Part of it's trying to show who is the "pack leader". I think it's also a matter of "steel sharpens steel". Mental and verbal joisting makes each other sharper and better able to perform whatever it is you're trying to get done (e.g. kill and bring home the meat to family). I've heard that surveys show that more women are attracted to fellows that hunt than those who don't. Sorry any of those guys who golf.
Oh, and women who hunt, I think are sexy.