Significantly!
There are things you can do to make them a bit quieter, but still not like a compound. Trying to get the energy needed to fling an arrow from a bulky crossbow comes at the cost of sound.