I can side with you, i try to be as quiet as possible and i feel like i am making to much noise. I had that problem last year and it wasnt that it was to much noise or movement im up in my stand and faceing that tree setting up, well i hear a couple of sticks on the ground break and some leaves crunching well i turn around and see this Nice looking buck stairing at me. Not really making noise or movement, but more so not being in stand at the right time.
But that situation has taught me to get to the stand a little earlier and try to pay a little more attention to what is going on around me while setting up!