I shoot a 500, and I've killed them just fine out to 35 yds with Win 3" #5 and a standard full choke.
I bought #6 loads this year. The pellets are only 0.01" smaller in diameter, but you get 54 more pellets to the ounce of shot, so over 90 more pellets per shell in comparison to #5.