For a starter kit I recommend this one.
http://www.cabelas.com/cabelas/en/templates/product/standard-item.jsp?_DARGS=/cabelas/en/common/catalog/item-link.jsp_A&_DAV=MainCatcat20712&id=0031353 215764a&navCount=2&podId=0031353&paren tId=cat20847&navAction=push&catalogCode=IF &rid=&parentType=index&indexId=cat2084 7&hasJS=true
As you go along you'll find other items to make your loading easier. For instance I have recently upgraded to an electronic scale/dispenser and a motorized station to handle the tasks like chamfering and deburring, cleaning primer pockets, etc. You don't have to spend a lot to get started.
As far as saving money, initially you have a healthy out of pocket expense, once you have your loads worked up that's when the savings start. Say for instance you spend $24 on a box of Winchester supreme ammo, the handloads would probably end up costing about $8 depending on which bullet you use. I see it as more of a hobby than a cost saving.