You might want to find out who he is before you go off half c0cked. If he turns out to be a good friend or relative of the land owner you might just lose a good hunting spot.
That said, I'd ask him if he was aware that baiting was not legal and see how he reacted. He might just be from an area where baiting is legal and never thought about it.
If that doesn't solve the problem, turn him in. Don't get too c0cky though, some of us 60 yr. olds can still put a knot on your head if you're not careful and, I've been shot at, and shot back, in a situation like this that got out of hand. Don't take it that far.