I have a G23 bought in 2004 with two mags. At least one of the two, often both, have been kept fully loaded ever since. No issues, and I shoot it often.
I would rather buy new mags every 6-7 years than get in a home defense situation and pay with my life for not having the extra 4-5 rounds available.