I went with the Rock Chucker Supreme Master Kit ($279.99 at
www.midsouthshooterssupply.com). It has just about all you need to get started minus the dies including a loading manual (Speer). I'd consider getting a load manual for the brand of bullet you're most likely to use, but (sometimes limited) reloading data can also be had from the various bullet and powder manufacturers. The Speer manual will have all the info you need to learn the basics of handloading.
The Lee kit is a lot cheaper than the RCBS, but I know the RCBS it top-quality stuff which is why I went with it. I do use the Lee hand trimmer for touchup and small batch trimming because it's faster set-up wise than using my Forster case trimmer, which I use for large batches when necessary. Of course, the starter kit come with everything necessary for basic, no-frills, handloading.
But be warned, once you start you're going to find that there are additional optional tools that you're going to convince yourself that you 'need' in the future (i.e. digital scales, Stoney Point seating gauges, electronic powder dispensers, etc...).

Some people want to start handloading to be able to make cheap ammo, which is possible if you are diciplined and willing to make do with a basic, inexpensive setup. But the truth is that handloading, for most, is a hobby that will tie up a lot of resources so if you don't load a LOT of ammo, your costs might actually be higher per round than factory ammo. But if you do it right, it'll be better ammo.
Mike