I' d make sure you keep that spot with the oak trees in your memory. If there aren' t many oaks in the area - you will see deer there once those babies start dropping. I' d keep them w/i comfortable shooting distance. If you max is 25 yards - you should be no more than 20 from there.

You may not see the buck there initially but rest assured - if the does use that area - at some point that buck will use that area too.