RE: I need some advice.
id say unless they are right in the middle of your hunting area you should be fine. The deer might actually become more use to human scent and that could work to your advantage. The deer mabey might think that the smell is just another worker.