Germ, I think you are exactly right and was very much the problem PA faced before herd reductions. Does came into estrous early, on time and late and the bucks killed themselves breeding only to have the does shot after they were breed. Too many does are hard on bucks, the does that are not bred the first round, are bred the second and if not the second, the third and at the times bucks should be resting and eating to make winter.
Fawns are then born way early or way late which in turn creates bad nutrition. It's a tough situation, too many does stunt their growth, compete for bucks nutrition which stunts their growth as well as antler growth (which wouldn't be evident by your last years harvest...lol) I think GMMAT sees that in his area right now, but he's working on it and with help from the neighbor across the way, roadkills, they've made a great dent.