To me when I hear a squirrel I think it might be a deer, so I look. When I hear a deer walking, I know it's a deer. Not sure how.
Squirrels, I think, then to "shuffle" the leaves more, while deer are a more distinct "crunch" of the leaves. Not sure if that makes sense.