The 25-06 is a great deer/antelope/varmit rifle. If you are set on buying the 25-06? Buy it you will love it. If you do buy the 25-06? Buying a second rifle for elk hunting. My elk rifle recomendation list starts out at 30-06 & goes up in size. I personally use a 300-win mag for elk hunting.
My #1 elk rifle pick would be a 300-win mag.
My #1 deer rifle pick is a tiebetween the 25-05 & 270-winchester.