I'm not sure how it works in New York, but in MO if someone is following you around, acting threatening or verbally threatening you, then you have every right to defend yourself.