It's been done...The Ferguson rifle, back in the 70s...The 1770s...
It could be done, it would be better if you removed the rifling from the area where the powder and bullet will be and after loading you would still need to make sure that the bullet is seated on the powder...
The better solution is to find the right bullet, sabot combination that loads fairly easily and is accurate...