Wouldn't the feathers wear a lot quiker than vanes?
No. On my arrows, feathers outlast vanes more than 4 to 1. Vanes get shot up, ripped, otherwise shredded in tournaments. Feathers take it all and keep coming back for more.
If they got just a little bit our of line with each other wouldn't it just mess everything up?
Not sure I understand the question... I don't know how feathers would get out of line with each other. I've played with staggered fletching, with each feather set 1/2" forward of the one before it. The theory was it would cause shorter feathers to stabilize an arrow as well as feathers an inch longer. Never saw any great difference from standard fletching, neither better or worse, so I quit. But, maybe that helps answer your question.
Overall, feathers will let you get away with a lot more mistakes than vanes will, especially when it comes to fletching contact on the rest, or even with the fletching grazing a stick between you and the target. Feathers will collapse to go around the obstruction with minimal impact on the arrow's direction. Vanes will hit and rebound, causing the arrow's flight to go wild until it stabilizes again. When it's finally stabilized, the arrow will likely take off on a whole new direction.