Elon Musk Activates World's Most Powerful AI Supercomputer

xAI's Memphis Supercluster, utilizing 100,000 Nvidia H100 GPUs, begins training for next-gen AI system

The Memphis Supercluster is powered by 100,000 liquid-cooled Nvidia H100 GPUs connected via RDMA fabric.
The new AI system aims to be the most powerful by every metric by December 2024.
The project is one of the largest investments in the Memphis region's history, with significant local job creation.
The supercomputer's power usage is substantial, requiring over 150 megawatts and 1.3 million gallons of water daily.
Elon Musk's xAI plans to use the supercomputer to train its Grok 3 AI chatbot.