The only way to avoid it is to shoot the does. Get everyone who'll listen to fill their antlerless tag, and report it. Otherwise, it's a lost cause. I hear ya about the peace and quiet. It's a shamee, and I don't like it any more than the next guy, but the fact is hunting is a management tool, and archers haven't been getting the job done.
The worse possible thing is an early antlerless rifle season, there'll be so many bucks poached, it'll be unbelievable. None reported and factored into the kill statistics, either. That shot you hear on the next farm over could be the buck you're after. Shame. I've seen it in MD with the does only early blackpowder. Aweful lot of bucks checked in on archery tags that weekend at the gas stations where nobody checks the bullet hole.