I can't honestly say that my scent has ever spooked deer that I know about. I've had several deer walk right over my trail.
Also, I can't say I've ever had a deer come in to to an attractant scent. Just shower and keep your clothes clean.