Here's an eye opener on .54 ball trajectory for you
Cayugad. This is my hunting load for my .54 Great Plains flintlock and is pretty close to what you were shooting. I sight in to be three inches high at 75 yards and know I'm good on deer out to 125 yards without thinking about it, and even 150 if I hold just below the spine.
As you can see, if you were sighted in about two inches high at 35 yards your trajectory pretty much matched this chart, and you would be about an inch and a half high at 100.