Don't know about the fruit, but the leaves and wood of a cherry tree are poisonous to deer. It causes cyanide poisoning if they were to eat enough of it.