I have hunted with Lyman Rifles. And took a deer with my Lyman Trade Rifle .54 caliber. Shooting a roundball and 90 grains of 2f black powder I shot a doe, on the boundary slash my property shares with a Federal Forest, at 52 yards. The bullet entered the front of the deer, hit the lungs, came out the stomach, hit the back leg breaking it, and where the ball went after that.. who knows. The deer dropped and never stood back up.
I also have a .50 caliber Lyman Great Plains Rifle in 50 caliber, a 50 caliber flintlock Great Plains Hunter, and a 50 caliber Lyman Trade Rifle Flintlock. But the 54 is the caliber I hunt with because it shoots roundball so well.
The other rifles also shoot roundball very well, even sabots and conicals. But it seems when I hunt with roundball I have luck. And for a roundball, I always prefer a .54 caliber or larger.