I would look into public ground that has trees. If you find trees more than likely there will be squirrels. You probably wont have much competition either.

http://www.gandermountain.com/modper...1&merchID=4006
As for a gun this is what I would recommend, the ammo is fairly cheap and readily available. Walmart should have everything you need.