I hunt over my persimmon grove every year. now i dont add vanilla or anything because the scent is strong enough in my opinion when they start to ripen up.
and as long as your not hunting directly over them im not sure it can be considered baiting.
But like ya said give your buddy a call and check it out.