You should be fine, actually it might be beneficial to leave some of your sent in the area for them to get used to. As long as it is non threatening then your sent won't be so foreign come deer season.