Alot of droppings mean their spending alot of time there , probably eating the acorns. Personally , I wouldn't set up right in the middle of it. I'd try backing off a ways but close enough for a shot. For the big buck , I'd try and find one of the smaller less noticable trails (probably made by buck) on the way to the oaks ,and back off of it 15 - 20 yards or so and set up there.

Good luck!