If they are truly your friends, they'd understand that it is more important for you to spend time in the field with your family. Sounds a bit like they are using you for something, whether it be your skills, equipment, knowledge, hunting and fishing spots, etc.... They should understand that family comes first.