If your eyes are swelling then you are having a pretty good allergic reaction. It could get progressively worse as MOTOWNHONKEY wrote.
I'd play it safe and talk to an ENT doc about it.

I get the little bumps on my forearms when gutting deer, but not when skinning or processing the meat.

Now when I skin raccoons, I sneeze and wheeze and am generally miserable. (after a couple hundred raccoons, you'd think I learn.....)