50# is plenty,especially if you have super sharp broadheads. And the easier it is to draw and maintain your draw the more confident you will become in your shot placement, which is really what bow hunting is all about. I shoot a 42 pound Bear recurve and have no problem killing deer. It will be my weapon of choice if I ever get lucky enough to draw a Michigan elk permit. No doubt in my mind that it will do the job. Heck at 10 or 12 yards, which is the range I shoot most of my deer at, a 35 pound bow with razor sharp broadheads would work.
Just hide behind a big old tree, become one with the woods and whack em when they walk by.