Free float the barrel. This may or may not make a more accurate rifle but it will usually make it more consistent.
Bed the action and 1-2 inches of the barrel. I prefer to use Devcon aluminum putty for this.
There are other things you could do but it becomes more extensive and costly.
If you have a pre X-mark trigger get it reworked or install an after market trigger.