RE: cheapest way to start hunting.
I guess on further consideration I would disagree. Given that the original posting stated all the gear could be bought from a store, it isn't do-able. Buying a suitable rifle and scope from a store is going to set you back $300 I would imagine. License may cost $20. Ammo may cost $10. Clothes bought on the cheap would likely run $20. Boots would likely cost at least $5. (I'm thinking Wal-Mart ammo and Goodwill clothes and boots -- these ARE stores.) A cheap knife in a second hand shop will cost $5. That is $360, and this is EXTREMELY cheap!!! If you could buy a rifle/scope for $100 you might be able to accomplish the feat described, but I don't know any store selling deer rifles for $100.