Are you bowhunting? I suggest you get a baitpile established a few weeks before hunting that spot. Start with a good amount of bait and when they start hitting the bait regularly, start decreasing the amount you put out. By the time you hunt you should only be putting out a handful. This will give them a sense of urgency to be the first to the bait and the dominant deer will be there first!
I would say move the bait back a bit, and remember, if he doesn't come into range and he isn't spooked, he will be back!
Knowing which way the deer will approach is important, so that way you can hunt the wind.
Once you figure out where they will come from, then you can set your stand up to intercept them.
Good luck and be safe!