the deer live in the woods, squirrels are not gonna scare the deer away...you'll have a harder time with bee's and predators.
i have had squirrels jump on my head before, while in a tree stand, scare the crud outta me, but they didnt tell the deer.