Sorry to say it Midwest, but that is just par for the course when hunting in NJ. If this is the first time it's happened to you, you are truly blessed. Leaving the stand in place will not assure you of anything, except that it has a better chance of walking away.

I've been dealing with this problem for over 20 years, even when other hunters know where my stand is. They set up near portables, permanents and ground blinds that are easy to see, it just doesn't matter. Some guy's will move if you ask them, some will get an attitude. I've had people tell me that since I don't hunt my stand every day, they thought it was okay to use it on the days I wasn't there. I actually had a guy build a permanent on private ground in the same tree that my stand was alread built in. He just went about 8 feet higher. Good luck, and welcome to NJ deer hunting.