Looks like you are in NY. The .308 will do everything head over heels on the .243, (no offence .243 shooters) simply due to its greater mass= terminal ballistics. You simply dont find hardly anyone (sure the exceptions will call in) in NY or the northern states shooting the .243 as they learn that in a hurry. Fine for the southern states though with their smaller deer (yes, I have hunted south, and the bigger deer ARE smaller, considerably.)
The .223 is a great mid ground if you are looking for an affordable varminting and target shooting round. It is still one hell of alot cheaper than the .243 to shoot, and is great on anything from crows to woodchucks to coyotes. As you have a great deer round, dont worry about crossing over, get it for what you will use it for.