There's lots of woods out there,why put yourself in a position where confrontation could occur.Obviously someone else is hunting there and has hunted there.It is not a matter of what is legal it is a matter of what is the decent thing to do as you asked.
The decent thing to do is to move on.