Like Hunters Life I try and load the fastest but most accurate load I can get. And like you I will gladly suffer loss of speed for increased accuracy. I've found that very few of my rifles ever shot max loads with the best accuracy.
IMO shooting a fast load that isn't accurate means you're only going to miss faster.