I just keep walking and pretend that I don't see the deer. Just DON'T follow it, or make it look like you are. If the deer thinks you are pursuing it, it will be very hesitant to return to that spot.