First thing is to take a hunter safety course.
Not only will you learn a whole heck of a lot, but you will meet other like minded people to befriend.
Buy a .22 Long Rifle (LR) bolt action rifle (Marlin) and a 12 gauge shotgun (Remington 870).
Now you are ready to begin........................SAFETY FIRST (always) !!!