Sounds like you found your answer. AND that you will do best with a clean barrel.
But If I were you, I would also be encouraged by the fact that even on a windy day and with a dirty barrel, you're able to put bullets into the kill zone at 100 yards. That ain't all bad!
Good Luck when you go hunting.