Frankly, it depends on what kind of distances you intend to shoot. If you don't intend to shoot much beyond 20-30 yards, I doubt you'd see much difference even with a 50 grain variance, unless you're capable of shooting pingpong ball size groups at 30 yards.

edit... I'd better point out that I agree with Bobco though. I'm not advocating using mismatched arrows.