I agree with you that once the Sun in up if not overcast, we find it best to take them down. Also, for some reason we've had more success with them field hunting at day break than on water. I can't say why.
We generally only have a couple up at a time though. I'd be interested to hear what others experience and how/when they've used them successfully.