Nothing at all wrong with the .308. It's an outstanding cartridge for deer. Not many that are better for your purposes.

As for any reduction in its popularity... that's probably due to folks afflicted with excessive levels of testosterone and bruises brought on by thumping their own chests... Classic symptoms of magnumitis... From your description, there's no need for you to get a magnum.