I had the same problem with some old arrows I found in the shed. I ran some coke a cola over them (the acid in it eats rust and stuff, you can use it to get corrosion off of car batteries too) and then soaked them in it for a minute or too. That was enough for a few of them. The others I soaked in vinegar for about 5 minutes. That got them.