How much wobble we talkin?

Its hard to believe that if the broadhead isn't aligned with the insert perfect, that they would fly right with your broadheads... but if the arrows are Flying STRAIGHT and all hitting the same spot when you shoot.. Then I dont see why that would affect any penetration..