I keep nearly every antler that I come across, whether it is a skull in the woods, a shed, or a deer I killed. I still have a set of antlers someone gave me when I was a little kid. I have plenty of room for them and for some reason it just seems wrong to throw them out. The only way I'd ever get rid of a set of antlers is if there was someone who wanted them.
This year I was hunting and I came acoss a large pile of bones right next to the property line, as if the neighbor had thrown them over his fence on to our property. There were several horse skulls, some turtle shells, and about 8 buck skulls. They had been out in the elements so long that they were soft and falling apart, you could crush the antlers between your fingers, otherwise I would have picked them up and kept them. It just seemed wrong to see them sitting there wasting away.