Are you tracking him and see where he is crossing the dirt roads? Seems like you have to find him and not wait till he finds you. When you find his crossings, back off 50yds and wait on him. If there is'nt any hunting pressure where he is crossing, he'll cross there again.