My grandpa used to keep a couple of small catfish or bullheads in his horse tanks. They eat any insects/larva and small critters that show up.

You would think that the water would taste "fishy" but he claimed that it didn't.

Kev