While it could always be the brand of powder or the amount of the powder charge, there's also air voids within the balls to consider.
Do you weigh or measure the cast balls?
And air voids may not all be identical in size or location.
Factory swagged balls will usually be a little more perfect and uniform compared to cast.