I bought my first .280 Rem. around 1963 and hunted with it for years. I then moved "up" to a 7mm Mag and also hunted with it for many years. I've now moved to the 7mm-08, and find it much more pleasant to carry and shoot. Most game taken with any of these were whitetail and groundhogs. I have loaded for them all,and settle on what the individual rifle likes to shoot the best with respectable velocity.
As others have said here already, flip a coin, or choose between the long action or short. Either one will kill deer-sized game quickly and cleanly. I'm sure you will enjoy whichever you choose............