I would say that they will grow up, but depending on the food they have during the winter months and early next spring will have the most effect on how much bigger they will get. As far as letting them go I think you did well because if you hadn't have let them go you would never have known if they would have gotten any bigger. Good luck next year on your deer quality!