Could be the rest. If you have simple shrink tube on the prongs I doubt whether that is enough to make your POI change as much.

You'd get the same results if your sight got knocked out of position too.
Best thing to do is paper tune or bare shaft tune the bow to check it out. Adjust as necessary and resight as needed. Very simple and should probably only take a short time if you know how to tune.