If you're out there and kill a deer and only take the rack then your are no better than the poachers out there that we are always fighting against. In fact you would be poaching and hopefuly you would get locked up and fined and hunting license suspended for life.

The number one reason to take an animal is for the meat.