RR it really depends on what you want from a gun. You've stated that it will be primarily a target rifle. In that case you really don't need a heavy caliber, with plenty of punch on both ends! Something along the lines of the .223 would be ideal. Cheap to shoot, accurate, and low recoil too! If you are going to be using it for varmints and game up through whitetail size, something a little heavier would be better! Like something in .243, 25-06, 260, or 7MM-08. These are good target calibers and have plenty of power for whitetail size game, without punishing recoil!
Remember, caliber alone does not determine felt recoil! Action types, (semi-autos recoil less than other action types, such as bolt actions.) Also, barrel length, type of stock, and total gun weight, along with different bullet weights in the same calibers, will determine how much a rifle will recoil!
For example, I have a .308 that I feel, recoils more than my 7MM Rem. magnum! Why? Because the 7MM is a heavy rifle and absorbs more of the recoil than my light weight .308!
By all means, don't get caught up in macho-ism! Get something that you can be comfortable with! I'll take accuracy over power any day! (up to the point of being under-gunned for larger game!)
Also, recoil can be a "percieved" thing as well as a "felt" thing! If you start out light, you can usually work up to heavier hittters without too much trouble, but if you develop a flinch from starting "with too much gun," it will be a hard habit to break!
I hope this helps! good luck!