I'd definitely quantify starlings as "vermin", but not necessarily varmints. They're nasty nasty birds.

But like many of the others here, I killed plenty of starlings as a kid with a BB gun as target practice and pest control.