I think if you tell your friends that you're going with your son or your dad and they still pester you, tell them, No, this is time I get to spend with them, alone. If they still have a problem with it then, it's their problem, not yours.