The 243 is more than enough to take deer with. This is even more true these days with all the great bullet designs available to hunters. The 243 is not a brush gun and is better suited to open ground hunting and this is where it really excels at.
For deer the one thing I truly know to be true is a well placed shot is much more important than the size bullet you are using. Shooting is a skill that must be practiced.