I have a .300 WSM for the big stuff and a .243 for deer and smaller.

I used to shoot a .22-250 as my small caliber, but it was too light for deer. .243 is the best of both worlds