Call in the police.

The owner can't fabricate a story about you.

If it is the grandson doing it without the grandparent's knowledge, they shouldn't get mad at you.

You can always find new land if it turns out to be the owner's pot.