I'd look into a bedding problem. Many full stocked rifled have problems in the bedding - it reads like when it gets warm it shoots "correct" indicating it might need a shim someplace in the barrel/action to wood fit.