I'd certainly build pts....

I'm a non-res so building pts for sheep, goat, and moose is out of my ability at the moment but as an instater do it!

also as an in stater you can apply for desert bighorn, so build pts/apply for those!

Also in CO if you draw a 2nd-4th choice etc....you won't lose pts, and gain another as you did not draw your 1st choice! so one thing you can do is put in for your dream hunt....best unit & best season and then put in for a 2nd choice with better draw odds so you can hunt every year etc....and still build pts for that better unit/season.