It's the curse of being a trophy hunter. If you're happy with a 5x5 or 5x6 you can hunt every year with no points. Get an elk every year, and have solitude.

I've never bothered saving any points.