When in doubt get permission. Every town clerks office has a tax map listing the deeded owner of any property. If a landowner never complains...no problem, but most would appreciate being asked.