First 100,000-GPU training cluster
2024-09xAI (Colossus)
xAI brought its Colossus cluster in Memphis online with ~100,000 H100 GPUs (~150 MW), built in months — the first single cluster at six-figure GPU scale.
Elon Musk's AI company; builds the Grok models and the large Colossus GPU cluster.
Editorial profile — compiled by us from public sources.
Standings and milestones are always verified by us against primary sources, regardless of who manages the profile.
xAI brought its Colossus cluster in Memphis online with ~100,000 H100 GPUs (~150 MW), built in months — the first single cluster at six-figure GPU scale.
Colossus scaled to ~200,000 GPUs and gigawatt-class power as GB200 racks came online — the first single site to approach 1 GW of AI compute.