Wow!! that is strange. Dead on at 100 yards and then that far to the side by moving simply 20 yards or more. I would be hard pressed to guess the cause. All I can think of is your pulling your shot. Honestly, if its not being caused by the wind I have no idea why that bullet would suddenly move to the side like that.
Maybe some of the long range shooters will have a better idea.