Buffalo Bullet Company swagged roundball are very high quality ball. They are all I used to shoot when I could get them. Check the box and make sure they say .490 and not .495 diameter. I have kept roundball around the house for years and never heard of them going out of round.
Next the patch issue. A .010 patch and that ball is nothing. I have seven T/C Muzzleloaders that shoot traditional roundball. I shoot a .018 patch. Are the patches you are using lubed with old lube? Are they pre lubed or are you putting an lube on them?
Addressing the breaking of the ramrod... are you using a short starter to set the ball into the muzzle? Granted I use a short starter. The small end to get it under the muzzle, then the long nose end to get it into the barrel. After that I use the ramrod. Try and push that ball down the barrel in one easy stroke.
What kind of powder are you shooting?