Ive done the same in early afternoon and hunted it later that night and been fine, its more a matter of where that sweat goes... I.E., if it touches any of the equipment, using gloves usually negates that for me, as that is usually the only thing that touches. IMHO, you should be fine within a couple days...
Scent is a weird thing; I have hung trail cameras that have sat in my spare bedroom for months and had deer show up on it within hours, other times, I haven't seen any for days. I try not to put too much into the scent I leave and more into what I can do to try and control the scent I can.