Certainly it depends on where you are but then again, people living in different climates are acclimated differently. What's cold for me is mild to hunters in Minnesota, I'm sure but they think I'm insane hunting in 85 degrees here so....
Generally no, it doesn't get too cold here for me. I can layer up pretty good and I have enough natural insulation....