Localized versus diffuse damage in amorphous materials