I'll answer this by telling a story. I had a trail camera in the woods on a creek crossing. Every day, for 10 days straight, I got pictures of deer. Religiously, every single day. Then, all of a sudden....no pictures. None. Zero, zip, nadda. So I did a little investigating. Well, all they did was alter their pattern to go BEHIND the tree w/ the camera in it. So, I moved the camera back against the creek bank, and bingo. Pictures again.

The moral of the story? Simple. They don't leave, they just adjust. He's still there, though he may be more nocturnal, but he's still there. You can get him.