It's public land so there really isn't much anyone can do if you hunt there. Although some people get territorial if you're in their honey hole so it might make for an uncomfortable encounter. Honestly, I would hunt the tree and if someone should get upset just handle it like gentlemen. You have as much right to hunt there as anyone else.