Aluminum are probably going to be the most accurate. They have better straightness, often to .0015, compared to carbons .003 average. If they are bent, they will be less accurate. They are also heavier on average, which will cause the arrow to drop faster if you are off by a couple of yards.

Carbon shafts are lighter, which makes them faster. If you are off by a couple of yards, you will not notice as great of a drop at aluminums.

There is not much difference between them though. I don't think most people would be able to tell the difference between them.