Depending on where you live, the cost of 25-06 ammo can be quite a bit higher than .270 Win. If you reload, this is not as much of an issue. As stated above, the .270 Win is easier to find on the shelf in stores.
It is possible you will have more meat loss with the 25-06 vs. the .270 Win. However, if you take a double lung shot (as you would with a bow) instead of a shoulder shot the possible extra meat loss is not a factor. See if you can fire a deer round in each caliber from the same model of rifle to see which you like better (try to have the optics and rifle the same for an apples to apples comparison).