A .22 rim fire rifle would work perfectly. You can pick up one from Walmart for around $100-$200. Or you could get a cheap 20 or 12 gauge shotgun. The 12 has more power than the 20 gauge, but personaly a 20 gauge us perfect for rabbit and squirrel. Try calling your wildlife department about the licenses you will need. They should be able to get you information about land that is owned by the government that you can hunt , aka wildlife management areas. I wish the best for you and happy hunting.