If you are just starting, I would VERY strongly advise AGAINST getting a progressive press. Start with a single stage press and get VERY familiar with each individual step of the reloading process before moving up to a progressive press. It will also be a lot cheaper. It will be a lot to control each step more in-depth with a single stage press.

As far as what you need to get started, it doesn't really require a lot to get started. Here's a list of what I started with a few years ago.
Single stage press
Dies for each caliber to be loaded(Lee dies come with shellholder)
Powder scale(in my case it was not digital)
Primer pocket cleaner
Case length gage
Cutter w/ lockstud
Case deburring/champfer tool
Powder funnel
Dial caliper(to measure case & cartridge dimensions)
Loading tray(to hold cases while loading)
Components for each caliber

Case tumbler is optional for case cleaning or you can use a liquid cleaner.

This may sound like a lot but it's really not. I spent less than $300.00 total. That included all components (I only load for one caliber right now). You can elaborate or substitute on this list but I think this would be a basic list and it will allow you to start reloading right away.