I let them walk all the time and often see the same deer from year to year.I should mention that I only own 125 acres and have considerable pressure (for this area) around me also. Two years ago I let a 130 class 8 point go on a 75 acre parcel a friend owns and he saw that deer two nights ago and said it is a brute now. There is heavy pressure all around that piece and he had not seen that deer at all last year. We know it is the same deer because he has a very unique narrow tall rack. The point is,if you shoot him young the only guarantee is that he will never mature. If you let him go there is always a chance he will make it. Kill what makes you happy but to just shoot a deer for fear a neighbor might get him first is not sound management in this area.