Not sure how Elk hunting goes since we don' t have any here in MA, but I' d probably head further up the trail in the direction I thought they would be coming from. On the way out I' d say in a nice gentlemanly voice " make sure you keep your eyes open in case any slip by me. I' ll be up the trail a piece. Good luck." Might be just enough to make him think.
Thats if I was in a good mood though. If I was having a bad day I' d go sit down next to him and say " You know what? You' re right, this is public land." Then I' d proceed to light up a cigarette and start singing to myself.