First you gotta change your avatar pic...cant haul a deer in that. LOL
Yes, you ALWAYS want to worry about your scent, those deer would prob be less offended by cologne than pure human scent. Find a good pinch point, inside corner, travel route to and from bedding areas, food sources. And you should be good to go, if you sit and keep seeing deer somewhere else, out of range...move.