DPHobby,
I have seen the 1st shot on a clean barrel go high, but not the 2nd shot. I think that the oil adds just enough resistance to increase the bullet (in the barrel) dwell time so that the barrel recoils higher by the time the bullet exits the barrel.
You might want to consider de-greasing your barrel then swabbing with WD-40, followed by 2 dry patches. That would offer some short term rust protection with minimal bullet resistance compared to a dry or fouled barrel. It would be good to check POI on each of the first 3 shots to see if there is a definite pattern.
Easiest though, is to foul your barrel 1-7 days before your season and then not clean the barrel till after the season. Only if you are using BH 209 powder though!!
Good Luck and good hunting.