I don' t think it' s a problem, though can see how if you use the camera in an area too often, particularly if you check it frequently or use it in a spot around scrapes during rut and leave your scent trail on each visit, could impact the movement of deer.
I' ve certainly had pictures of deer that were spooked by the camera, but on balance I would say that happens in probably less that 10% of my pictures. That said, since I' ve also seen the same deer many times (big bucks, not just does) in a series of pictures, clealy the camera isn' t causing the deer to leave an area after repeatedly getting famous in my picture collection.