Your gonna get some flack on this topic from people who don't like baiting, but I'll take a shot at an answer for ya. From what I know, it sounds like you are putting out too much bait at once. You don't want to "feed" the deer.You want them to know where they can get some food, but don't over do it. Also, amature buck most likey won't come into the bait pile and eat so don't hunt directly over it. Set up along a well used trail instead. If you attract the does, a buck will be there too, but he won't come into the pile for a shot.