You just answered you own question. It did not address the LANDOWNER. It is still his land and unless it gives you and whoever else is stated in the agreement exclusive rights he is legally able to have access to it and whoever else he decides to join him. It is not very ethical of him but it is legal. Sorry for your misfortune. Get a better agreement next time and good luck.