Ignore it and hunt.
If you do tear it down your basically taking the law into your hands.

Especially if the person that walks up on you is the one who put it up.
Then what?