I killed my first Whitetail deer, a buck, with a Smith & Wesson .44 Mag. and maximum handloads using 180 grain hollowpoints. Hit with a double tap at 10-15 feet while crossing right to left, I saw his eyes bulge with the impact. He landed in a heap. I stepped over to where the bullets hit him and found blood in fine droplets sprayed onto the leaves of nearby trees. One round hit his shoulder blade and the other went into the leading edge of his rib cage. When I opened him up he looked like he'd swallowed a mini-frag grenade. The bullets had detonated on bone and all the surgeons in the Mayo clinic couldn't have helped him. That was the last time I hunted with that load and later found 240's do a more consistent and uniform job.

I'd rather not say much about your guns since deer season is over in most places. What ever you did is now done. I'll just comment that a handgun can be used to take deer, and where you hit them is more important than what you hit them with. I'm fond of bigger bullets both in bore and weight, only because I've seen the results. More speed is better than less until the handgun becomes so powerful you can't shoot it effectively. In effect, your skill becomes the limiting factor.

I wouldn't be shocked to learn you killed a big buck with your .357. It can be done, even with a first deer. I still have the rack to prove it.