The link below is a short very interesting article on shedding of antlers and reasons for early and late shedding. I think you hit it in that buck was semi tame and was used to living close to those homes and didn't feel that the guy was a big threat as long as he was up where he was.

https://www.qdma.com/articles/causes...antler-casting