If you just walked by and went on your business, you're probably
OK.
Deer will skirt around "potential" danger. They will flee "real" danger.
What I'm saying is, if you followed him and made him keep dodging you, he'd know he was being pursued and do something about it. If he just ran off a little and you just passed by, it would be like any other day for him. They're used to taking precautious measures. Coyote, bear, bobcat, hikers, ATVs, etc... They know when they're being pursued and when you're just passing through.
He's probably seen you check your camera before.