I'd consider a good rifle. You can get amazing deals on deer rifles that will last you a lifetime if cared for properly.

I'd look into a marlin XS7 in .243. You can easily find these for under 300 bucks.

A step up would be a marlin model 336 in 30-30. These can also be found for dirt cheap, probably around 350.

Good luck.