During bow season, like others have said, when I can't see well enough for a clean and safe shot.
During rifle season, when legalshooting hours are over. I stay right 'til the last minute, then begin my 1/2 hr. walk back to the truck.