RE: weather vs group size....
Any wind involved? The only thing I can think of that would cause a flyer, other than shooter error, is a gust of wind somewhere between you and the target. It doesn' t take but a 10mph crosswind to screw up your groups, even at 100 yards. Especially if it' s sporadic.