My limb driver is very quiet.
I have moleskin on my arrow shelf and the tension set up so the rest is pulled HARD into the moleskin. This seems to keep everything quiet because at the shot, the rest is under tension, thus very little vibration.
This is a really crappy picture, but you should be able to get the idea.