Even when the big ones would chase the spinners, it was like they were only hitting on it cause they were annoyed or being territorial, or something.
Yes sometimes fish do hit cause they are annoyed or being territorial, and thats actually what spoons and spinners tend to do is trigger the territorial instinct in fish (thats why i really like to use them when the spawn is on).
And you can annoy fish by throwing the same thing at them alot but that tends to be time consuming with little results.