In Michigan, you basically have squatter's rights. In a public-land situation (which I know this wasn't), it's first come first serve on a blind--regardless of who put it up. Yes, that takes a lot of balls and it's a dick move...but from a technical standpoint it's legal.

I'd get the property owner involved. I sure wouldn't want idiots like that hunting on my property. I don't care who they were.