Being in Fl, I would highly recommend getting out fishing, alot. You guys have some of the best fishing around and a easy trip to the coast every once in a while, jumping onto a head-boat can land you pounds of meat in no time. As mentioned, doesn't make it cost effective if you get biting by the fishing bug. I have close to $10000 in fishing gear in my garage last I attempted to calculate for insurance purposes and that doesn't include the boat stuff I still have, that is just rods/reels, tackle, lures, bags, etc.
But fishing can be done for cheaper then hunting, and you can do fishing year round while you get set up and prepped for hunting.
1. Hunter Safety Course
2. Licenses
3. Basic gear list (search this site, it has been asked many times)
All the rest is just getting boots on the ground and learning.