BamaKiller,
Also note in addition to being illegal, you may also run afoul of the law by not turning him in. If you are hunting within a certain yardage of bait, doen't matter that it is not yours, you could get in trouble. The Alabama Code also does not specify that you own the land in question, so if you are in close enough proximity, you are also hunting "over" that bait. i think the advice given to have a friendly conversation with your neighbor first was the best avenue here.