Sounds like you are in the right spot but at the wrong time !
I would put a game camera out and fine out when that buck or bucks
are eating and using that area.
good hunting