I would just ask or tell him nicely to please stay out of the area so that he doesn't spook the deer before hunting season. Does he also hunting the same area? If so then I guess there isn't much you can do about it other than try to tell that you would appreciate that he not disturb the deer.