Honestly, I would take it back to the smith. That rifle should shoot rocks MOA.
The advanages I get by reloading is mainly fitting my brass to my chamber every time. Second, adjusing my bullet depth. Sure, powder and charge and primers make a difference, but the two above makes the most.
Which smith did you take too? I am fimiluar with that shop