I personally don't believe that accidentally taking a button-buck is such a terrible thing. I'm not advocating that you go out gunning for them, but hear me out.

During their first year, button-bucks are run off by their mothers. They usually end up miles away. This is called dispersal and it occurs with almost every living thing on the planet. This keeps that little buck from breeding with his mother, sisters, aunts, etc. Therefore, that little button-buck will most likely never be seen on your property as a mature deer.

Just my 2 cents.