You have several more than capable caliber guns as it is. It doesn't take much to kill a deer if you can make a good shot.
I'd go shotgun so you can do some bird hunting as well.
As far as making a 400 yard shot goes, well, the 7mm mag with the proper optics will do the job just fine. So would the .270 come to think of it.