"I wonder whether these muscles and ligaments can recover once they have started to atrophy..."
Even worse- they never even have a chance to develop! Young girls today are wearing bras before they even have breasts! Their muscles/ligaments never even see any need to develop because they have nothing to do. I think this is why I hear even very young women complaining that their breasts sag without bras.