You're doing it right. The only "lightweight" semi-auto that you can rack with a thumb & index finger, is a compact .380 like the Ruger LCP.
The classic 1911 is a beast and always has been. Given the heavy gauge steel frame, steel slide, steel magazine, etc.. It averages 2.7 lbs and means business!
I have a good friend of mine from our Masonic lodge, who has shot my 1911 at the range, and jokingly nicknamed her "Big Bertha"! LOL...