It't not just all about "holding it's zero". I've seen cheap scopes get cloudy or fog up in weather that had no effect on better quality scopes. You'll also "generally" find the optics clearer and less distortion in higher level scopes.

I haven't used the Leupold rifeman scopes yet, but the rest of their products are superb. I also currently own six Bushnell Elite scopes. So far I've found them as good as my Leupolds except for slightly less eye relief. You should be able to find an Elite 3200 for a bit less than a Leupold.