I have not noticed velvet shedding having any effect on deer patterns. I have been glassing deer and notice one day they are hard antlered... However, right at about the end of August, early September there are many changes in food sources such as acorns starting to drop and beans turning yellow and bitter... As others have said, I think your issue is with food.