Wow, that is terrible. I had a similar experience but at the target range instead of hunting. I had my gun about right and took it out one more time and it wasn't even on paper. Turned out the rear scope ring was really loose. So I tightened it down and took it out again to re-sight it in.
I hope you get another chance at those guys.