If recoil is a concern, I'd rule out the .308 in a light rifle. It would not be much less in recoil than the '06!
The .243 with good ammo is all the whitetail medicine you'd ever need, but the 7MM-08 would give you more options! Plenty of power and light recoil to boot! The 7MM-08 is as perfect a deer caliber as you could ever get.