I'd suggest a 243 for the simple reason you have never fired a high power rifle. No reason to start too big and develop a flinch. You will also want to look at getting a scope with a decent amount of eye relief so you don't get the famous "shooters eye."

I've shot quite a few deer past the 300 yard mark with my 243s, and my SD deer are about twice the size of a big Texas deer