Doesn't sound like that bad a deal , deer passing thru , maybe going from food to bedding. Just work with what you have, try to get a little clear spot in there for sunlight and plant some clover, keep a little undergrowth present for feeding and maybe stick a salt lick near a trail,keep people and pets out of there as much as possible...