Are you hunting with a gun or bow? I've never bothered with camo when I was gun hunting because it was just covered up with unpatterned blaze orange anyway. I figure if they can't see the blaze orange, they aren't going to see the carhart tan.

Since I've started bow hunting, I think the camo helps. You can still get deer close without it, but there will be times when an alert deer is coming in, and the camo may provide that extra level of deception to draw it in closer.