Well you certainly have to take into account what the rifle will shoot well,sometimes that's a relatively light load.
I have found that a lot of guns that don't have any problem like bedding difficulties etc. will tune up with two loads quite a few of my guns will shoot70, 80 or 90 and then group again at 110 to 130, I believe this is due to the circular vibration of a rifled barrel when the barrel comes back to the rest point [where it started] most seem to shoot best if the bullet exits at that point. If you ever get a chance and have not seen it watch the slow motion pictures of exterior ballistics bullet mechanics. I do not know if they have ever put it on the Internet or not.
I personally have found most of my best accuracy loads seem to be around 110 gr, I like to shoot for accuracy so I generally use the most accurate loads I can find. It is also my opinion that loads beyond 135 gr with a lot of powders add to the recoil and waste a lot of powder, BH209 may be the exception to this as it seems to keep adding a quite a bit to the velocity, it adds quite a bit to the recoil too, and for me personally 2100 or 2200 fps is all I need, I do have an occasional long shot. Lee