Elon Musk fires up ‘the most powerful AI training cluster in the world’ — uses 100,000 Nvidia H100 GPUs on a single fabric

[Pelican Press 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

Elon Musk fires up ‘the most powerful AI training cluster in the world’ — uses 100,000 Nvidia H100 GPUs on a single fabric

data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///ywAAAAAAQABAAACAUwAOw==

Tech baron Elon Musk has taken to

This is the hidden content, please

• Sign In
• or
• Sign Up

/X to boast of starting up “the most powerful AI training cluster in the world” which he will use to create the self-professed “world’s most powerful AI by every metric.” Today, xAI’s Memphis Supercluster began AI training using 100,000 liquid-cooled Nvidia H100 GPUs connected with a single RDMA (remote direct memory access) fabric. Whether Musk personally flicked the switch to start up the supercluster seems unlikely, as it is noted that it commenced its gargantuan task at 4.20am CDT, but he did

This is the hidden content, please

• Sign In
• or
• Sign Up

.

Nice work by @xAI team, @X team, @Nvidia & supporting companies getting Memphis Supercluster training started at ~4:20am local time.With 100k liquid-cooled H100s on a single RDMA fabric, it’s the most powerful AI training cluster in the world!

This is the hidden content, please

• Sign In
• or
• Sign Up

In May, we reported on Musk’s ambition to open the Gigafactory of Compute by Fall 2025. At the time, Musk hurried to begin work on the supercluster, necessitating the purchase of current-gen ‘Hopper’ H100 GPUs. It appeared to signal that the tech tycoon didn’t have the patience to wait for H200 chips to roll out, not to mention the upcoming Blackwell-based B100 and B200 GPUs. This is despite the expectation that the newer Nvidia Blackwell data center GPUs would ship before the end of 2024.

So, if the Gigafactory of Compute was touted for opening by Fall 2025, does today’s news mean the project has come to fruition a year early? It could indeed be early, but it seems more likely that the sources talking to Reuters and The Information earlier this year misspoke or were misquoted regarding the timing of the project. Also, with the xAI Memphis Supercluster already up and running, the questions about why xAI did not wait for more powerful or next-gen GPUs are answered.

Come help xAI route photons as a elite fiber tech in Memphis! pic.

This is the hidden content, please

• Sign In
• or
• Sign Up

.com/JJShV75May

This is the hidden content, please

• Sign In
• or
• Sign Up

In a follow-up Tweet, Musk explains that the new supercluster will be “training the world’s most powerful AI by every metric.” We assume from previous statements of intent that the power of xAI’s 100,000 H100 GPU installation will now be targeted at Grok 3 training. According to Musk, the refined LLM should be finished with the training stage “by December this year.”

To put the Memphis Supercluster compute resources in some context, certainly, going by scale, the new xAI Memphis Supercluster easily outclasses anything in the most recent Top500 list in terms of GPU horsepower. The world’s most powerful supercomputers such as Frontier (37,888 AMD GPUs), Aurora (60,000 Intel GPUs), and

This is the hidden content, please

• Sign In
• or
• Sign Up

Eagle (14,400 Nvidia H100 GPUs) seem to be significantly outgunned by the xAI machine.

Perhaps xAI should be congratulated on the speed at which it has got the Memphis Supercluster up and running on a meaningful task. However, some would argue AI isn’t that meaningful or useful. Indeed, industry leaders have warned that we must start seeing some revenue generated from the billions invested in the great AI race. AI has certainly been underwhelming on the PC side of things, with

This is the hidden content, please

• Sign In
• or
• Sign Up

’s Recall misfire and the web services we have access to, which are prone to mistakes and dangerous hallucinations.

Get Tom’s Hardware’s best news and in-depth reviews, straight to your inbox.

This is the hidden content, please

• Sign In
• or
• Sign Up

#Elon #Musk #fires #powerful #training #cluster #world #Nvidia #H100 #GPUs #single #fabric

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up

For verified travel tips and real support, visit: https://hopzone.eu/