I don't bait, but I think that the evening would be the best time to hunt over it. After lying around all day, they're hungry when the get up and would be likely to go there first. After feeding all night, they may have already been there by the time you arrive or you might bump them away. Since they would likely be full by then, you're less likely to see them in the morning. Just my thoughts.

Today's small bucks are tomorrow's trophies.