You need to look at what food sources are available on neighboring properties. It definitely sounds like the deer are hitting different food sources than what your property has to offer during the time that they are gone.