I just got my first deer rifle and took it out to sight it in....the first day i was golding quarter groups at 50yds

.....then when i move back to 100 i find my shots spread out all over the place (this is on a dead steady rest)[:@]..... Im shooting a Rem. 7600 pump action 30-06....does anyone know whats happening....im starting to think my gun is defective?