Kid...I asked myself the same thing about 30 years ago...It didn't work out, too many patches simply won't hold up to the pressure...
What I do is sight my rifle in at 25 yards with a half charge of what I use for deer hunting...I like my flintlocks sighted in about an inch and a half high at 50 yards and dead on with a half charge at 25...
Take head shots, no meat is destroyed...
I now have a .40 that I use with 25grs of Goex FFF for squirrels and such and a .54 that I load up with 80grs of Goex FFF for deer...