Nothing to be ashamed of- I'm not a fan of magnum loads either. Yes, I CAN shoot heavy-kicking loads (i.e. 12 gauge shotgun full-power slugs, like I used to for deer hunting), but I prefer not to punish myself. I know for a fact that I shoot better when the recoil is less. On the other hand, I will shoot what my rifle shoots best- in my case, that is 95 grains of 777 FFFG. If my rifle shot better with 110 grains, I'd probably shoot that, but it doesn't. I used to shoot 80 grains 777, but found out the "sweet spot" is 95 grains.

Keep in mind how many bison fell to the old 45-70 shooting 70 grains of blackpowder (equal in velocity to 60-65 grains of 777). So you're by no means underpowered for hunting.