Could it be drought related. Or it could be a problem with pollenation. There is a lot of talk about the bee populations being way down in many parts of the country. If not properly pruned the sucker branches rob most of the nutrition that goes into the fruit. Best time to prune is in late fall.......dabow