I looked into this exact same question with these exact same rounds two years ago when I was deciding what to use through my Rem 700. I even made a graph to compare the energy and trajectory of the three rounds.
I decided on the 165 as being the best. If I remember right it was almost as flat-shooting as the 150 grain in terms of trajectory, yet almost as much energy (knock-down power) as the 180. If I can find the graph when I get home I'll post it.