Yeah, no way to tell what's going on if you switch ammo. It can make a really big difference.
Flinching should manifest itself as large groups or fliers, not consistent small groups at different POI.
I have, rarely, seen this happen when people change their eye position behind a scope without parallex adjusted correctly. But that is not common and not 9" at 100 yds.