I have never had a problem with letting people hunt my ground with me. However I also hunt their land with them. Its a good understanding that you only go when invited and don't bring anyone else with you. Also the rules apply to the woods you are in(which may be different than your own). Now problems with tresspassers and neighbors thats a whole different story.