Pre-training# L1AppL2FrameworkL3ParallelismL4RuntimeL5CommL6TransportL7FabricL8InterconnectL9GPUSStorageCPControl conceptstub Training a foundation model from scratch at scale. Planned content 3D/4D/5D parallelism Gang scheduling and failure recovery Fabric and checkpoint storage as the critical path