It is probably struggling to know if it is daylight or dark, since the times that you mentioned when it did this is pretty close to sunrise and sunset. I think most IR cameras have that same problem. I know my Moultries did when I first got them. It has gotten better since their firmware update but they occasionally still have that problem.
Blessings.....Pastorjim