For the average guy and $500 Ruger, Savage, Tikka, and Weatherby Vangaurd are all great places to start and will leavelittle to me desired. Go to the store pick a few up and see what feels best and has a natural point of aim.

As for caliber you want something well rounded that will serve you well for years to come in a verity of fields. You don't want a magnum most likely since you haven't hunted much because a flinch is a terrible habit. Any of these will serve your need perfectly 243, 260, 7mm-08, 308, 25-06, 270, 280, or 30-06. There are more but these are the basics and ammo can be found easily and affordably.

Optics is a big deal also. I good rifle with a cheap bubble pack walmart scope may work but you will be better off with better. Look for a scope from a repitable brand like nikon, leupold, or bushnell. $125 + to start with if you are on a budget.

Welcome the sport and enjoy the process of getting you first gun.