I used to have a .535 mold and made a lot of ball once. When I tried to load them in my Renegade with a .015 patch I had to beat them down the barrel. I shot two of them. And after that used the couple hundred I made as sling shot ammo. Which by the way they worked really good for. I ended up selling that mold to Semisane I think it was. But he then made some ball out of it (beautiful job) and they do load in my Lyman Trade rifle. They are tight, but I can load them.
Although the kind of groups you are shooting are more then acceptable. In fact I would be down right tickled to death with them.