If you want an inexpensive rifle for whitetail get a remington model 7 in 7mm/08 and never look back. The 7mm/08 is truely the perfect whitetail cartridge (that should start some arguments). If you want to spend a little more look at the remington 700 mountain rifle, light and handy, I shoot one in .270.
As far as inexpensive scopes I have had great luck with the bushnell trophy series 3x9s (around $100.00). I have been so impressed with the accuracy of these cheap scopes I even mounted one on my weatherby this year.
Good luck shopping.