Hunt the property. The deer are most likely to run to where they think it's safe - back onto the flood plain and not the neighboring yards.
I can certainly understand the awkwardness of the situation though. We have some deer in our neighborhood that live in a strip of woods that's only about 300 yards wide and 600 yards long. You can often walk to within 10 feet of them. I have no doubt it would draw the ire of some of the neighbors if a hunter was seen taking one.