They can be a big problem. They are direct competition with deer for food, and the deer dont like to be around them. I have seen them run deer out of an area. I would suggest trapping them if legal in your area.