I don't think exotics are the money maker they once were, especially since they have become so common. Also keep in mind any changes to land use can affect property tax values.
With 4100 acres properly managed, if it is all in one general location, you can exercise enough control over your deer herd to provide some management without a high fence.