If you're having no prob's at 100 yards, then I'd say it's not a trigger issue. Also, regardless of the lbs. of trigger pull, IMO you shouldn't be getting shots pulled off to one side because a good trigger pull is straight back inline with the gun all the way back to the stock.
You also didn't specify which direction the wind was coming from, but by your picture I'm assuming from the left side. LOL!
If you are shooting good groups at 100 yards, your 200 yard shoots shouldn't be that bad either, so I'm thinking wind.
iSnipe