While this group was shot at 75 yards, not 100, it shows that even a sidelock with a peep sight can shoot much better groups than what your getting.
This 3 shot group was shot at 75 yards off a bench from a Lyman GPH 50 using a peep sight. Load was 460 No Excuse bullet over 70gr of 777 3F. Measured .280 center to center. Orange dot is 2" diameter. I did swab between shots using a spit patch.
Good luck finding a load.