As long as deer don't associate the scent with danger, I don't think they have a problem with it.

Granted, this may not be true for monster bucks, but for does and smaller bucks I think that this is the case.