Usually the harness is the culprit in noise, since it's usually a harder material strap.

Wrap it with cloth tape or moleskin (bow-felt), or sew on a fabric or fleece sleeve, around the contact points on the harness. Even some "hairy side" of Velcro will soften that sound (just watch the edges).

Wrapping the strap in duct tape can even help.