If both of you are hunting right out from your backyards I don't see a problem with it. maybe just go as far away as you can on the end of your property. If he can not see you, nor here you then I don't think it is a problem.