I am a reloader that does not think reloading is worth the time or money.
The information you provided about the amount of times you shoot per year and how picky your 30-06 is makes me believe you will never pay off your investment in reloading equipment.
I think you would be just throwing money drown the drain. I have a rifle that I never could find a reload that shot better than Federal Premium Ammunition. I have almost given up on reload myself due to the extra time involved in loading ammo vs buying it off the shelf. I still reload for a few rifles, but I am thinking about loading up the brass I have and selling off all of my reloading equipment.