if they know that you are after something else they will just come to the tree you are in.
LOL! Ain't it the truth! I don't know many folks will admit to it, but I suspect a lot of deer hunters have been suprised because, while being distracted by the antics of a local squirrel, they have been suprised, or caught off guard by approaching deer.