I'd be concerned that since you have a small tract to begin with, if you take away or reduce the cover that the deer have now, it might push them off your property. Without knowing the specifics, such as topography, bedding areas, transition zones, etc. I can't say for sure what would happen, but if the hunting is good now, don't mess with the timber, unless it's a $$ issue.