While a proper bullet with proper bullet placement will certainly kill an elk, I would recommend something with a little more power, like a .30-06, 7mm Rem or .300 Win mag, topped with a good 3-9 variable scope. I prefer bold action rifles with 24" barrels. My favorite elk rifle now is a .300 Weatherby vanguard topped with a 4.5-14x Leopold scope.
Remington, Savage, Weatherby vanguard/Howa all make good inexpensive rifles. Leopold, Nikon, and Burris make good scopes.
I hunted elk for about 30 years with rifles with blued barrels and wood stocks, but I now have a backup foul weather rifle with a stainless barrel and plastic stock.
I only shoot reloaded ammo, but for the occasional shooter, there is good factory ammunition available. Although I have killed many elk with standard cup and core bullets, I would recommend a premium bullet like a Barnes, Nosler Partition or Accubond for elk. In 30 caliber, 180 grain bullets are pretty standard for elk.