Is everything tight, especially the rest?

I had something similar happen to me and I kept looking at everything but nothing seemed out of place. Finally I started checking screws and the rest was ever so slightly loose and was moving such a small ammount I didn't notice it.

Another thought. Do you use a Trophy Ridge sight? If so I would look real hard at the sight moving.