Inference Platform# L1AppL2FrameworkL3ParallelismL4RuntimeL5CommL6TransportL7FabricL8InterconnectL9GPUSStorageCPControl conceptstub A multi-model, multi-tenant serving platform. Planned content Model serving tiers GPU sharing strategy Disaggregated prefill/decode option