My '06 load for years is 49.5gr IMR4064 for the 180's (2700'/sec). 51gr for the 165's (2895'/sec) and 52.5 gr for the 150's (2990'/sec). Don't know about the Barnes XXX speeds as I can't get them to group well in my rifles. The biggest problem I find in the '06 is with the slow burning powders that take up so much case space you end up compressing the load. I don't really mind compressing loads if there are no pressure signs, however, I would rather have the powder fill the case without compression or have a bit of room left over. Those Barnes bullets are really long so I would opt for something like the 4064 that doesn't eat case space. One good option would be to Ackley the thing and not worry about compression!
Good luck and regards, Rick.