I'd be even MORE concerned about damaging arrows with a "swinging" target. If the target is swinging, you have a greater likelihood of hitting the actual SHAFT of another arrow.

I've actually put arrows through the SIDE of carbon arrows because the target was swinging, like you described. I think the safest thing to do is just shoot at different dots.