I will group shots with a clean barrel, and then have POI move after 3 or 4th shot.
More rounds, just to make sure you don't have some outlyers. Even with lead sled it can happen.
Not sure if you need to do 30-50. But I would fire some more. Letting barrel cool 10 minutes between shots, if you want the most accuracy. Fire a 10-20, and see what it looks like.
Another option, is to try another load or bullet.
If loaded the same, I don't believe it is actually producint 2 groups. You just got 2 bullets near each other, out of 5. Shoot some more.
I also say to watch how you are grabbing the trigger. Square your finger with it. Make sure not pulling it to one side. Again, I notice this more in handguns. But same idea.
Speaking from my bowels, I think seating depth is a different discussion.
Clean barrel. shoot 3 rounds. Then shoot 10 or more and see what you got. I like to number mine, more so for fouling shots, and as things get dirty.