It is one of these:

You are applying torque to the riser

As Bowfanatic said you are pressing to hard into your face

Your aiming eye is too far left of string

your rest is too far left

your spine is stiff (and it might be)

you are canting the bow when you shoot.

you are getting some major fletch contact

Are the arrows flyimg well?