Riding the horses does not bother them as long as they are not riding an shooting at them. But walking through the woods an hunting woodchucks would put a damper on things. You need to have an area set aside that you don't go into to do any activity an that the deer would be comfortable bedding down.