When I first was taught how to load, I was taught to "throw" the ramrod against the ball until it bounced - no longer giving a dull "thud". I did that for a long time, then saw others just pushing the ball down firmly on the charge. I have been doing that ever since and feel it's a better idea.
For one thing, it doesn't take as long. For another, if you were to use pellets, I'm pretty sure you could break or crush them. And thirdly, I feel you'll get consistent accuracy as long as you load with consistent pressure.