The way I see it its your land and you can do what ever you want.....

Like the others have said, the last thing in the world anyone needs is a pi$$ed off neighbor. Trust me on that; I've been living a family feud for the past 15 years.