Well back in the day it was plaid shirts and coveralls. I've stalked game in blue jeans and t shirts bowhunting and got it done. Is camo a replacement for good hunting skills? I don't think so. But it does make a difference breaking up outlines and blending. It slows your movements in backgrounds. I've switched a particular camo because in the area I use to stalk game in the open it blends better than anything out there. In the woods it lightly colored so it blends like a animal does in the woods.
You don't need camo but I can vouch for it working better. The difference between the ole darker camo I used to use and the new lighter camo I use now I get spotted 50% less and get alot closer. That's a huge difference in what I do. It's not vanity it truly works better I have to admit that outright.
Any bright or dark color has the STOP sign effect on game if your moving. It's a solid object moving. Same can be said about camo if your look too dark or too light then deer know bushes don't move. Pick the best color blend in the area that your hunting in. To my knowledge that's the best camo. So in certain circumstances a perfect color fleece pull over could be in fact be a great choice if it blends well in the background.