What I would suggest is to tinker with your load until you find the one that shoots the most accurately (consistantly). Then practice, practice, practice.
I would also stay with the 54.
My personal choice would be my T/C Hawken .45 with 200 gr - .400" XTP pushed by 80 gr of Pyrodex P. Good luck to you - hope you fair well.