That is usually exactly the case. This is usually refered to as the transition zone or staging area where the deer will hang out and browse before entering a field or food plot. The exception may be during the rut but at the same time, bucks will often cruise inside the woods around a perimeter of a field looking for a receptive doe path.

You' ll loose shooting time but gain the possibility of taking a more mature buck while hunting these transition zones/staging areas and especially if your transition zone has a natural funnel effect but the loss of shooting time might not be noticable when the bucks cruise in and your arrow finds it mark.