I've been shooting with WBs for 6 years, I use 4" vanes and have no "real" problems other than some wavingwhich doesn't effect my accuracy at all. As far as the bristles getting all mixed up, I've never had this happen. It sounds like your arrow isn't passing "straight" through your Bisquit for what ever reason. Check your centershot.
What your describing sounds like a tuning issue, either with the Bisquit, the bow or both.I wouldn't "hunt" with any other rest. Also, there is some noise when drawing through the Bisquit, but I've never had it scare or alert any deer. Both of my bucks this past season were under 20yrds when I shot them.