It sounds like an excellent spot. Although I had a very simmilar situation when hunting an unfamiliar area last year. I 'bumped' a nice buck twice before I realized how good the area was. The outcome was the dropped the use of those scrapes like a bad habit.
Although he didn't leave the area, because he slipped past me on the opener without giving me a shot.

Good luck