Quite possible, i suggest you head back and see if the first shot was human error or the gun likes a bit of fouling to produce the results you expect. If so then shot a fouling shot and go hunting! In my case a clean barrel has no effects on my POI, so I haven' t experienced this problem but if your gun likes some grit than give it what it likes.
Did you have a heavy coat of oil in the barrel? This can cause POI shifts and after the first shot you burned it off to return to normal.