Until the barrel is broken-in, clean between groups. I cleaned the barrel, fired a fouling shot, then a 3 shot group, and clean again. After about 60 rounds, there wasn't much fouling and groups were very consistent.
I cant imagine its anything to do with the scope or mounts.
That's not always a safe assumption as you are assuming something is wrong with the rifle after firing three shots.