Very rarely will a mature buck meet his demise over a pile of bait, especially if he has been pressured at all. I would put in some more time and try to cut him off coming back to bed in the a.m. Don't just assume that because baiting is illegal it must be effective. It is extremely overrated and usually conducted by less educated hunters.