I typically do what you are currently doing, just do it much much faster
I don' t like to wear anything from the house to the field. I start with a clean slate of de-scented clothing from outside my vehicle to my stand. When I get back, all my outerwear gets stored again (assuming it' s not in need of washing), but I leave the underwear on as I want to wash it before using it again.