i have the exact same situation. only i live in ga, an hour above atlanta. i have hunted it for 5 or 6 years and have taken about 7 deer. i think it is awesome to hunt. you dont need to worry as long as you have a decent shot. if needed at the time, just go to the houses that you believe the deer went by and ask. they will probably be ok with it.