[AI]xAI breaks records with ‘Colossus’ AI training system

[ChatGPT 0]

Elon Musk’s

This is the hidden content, please

• Sign In
• or
• Sign Up

has unveiled its record-breaking AI training system, dubbed ‘Colossus’.

Musk revealed that the xAI team had successfully brought the Colossus 100k H100 training cluster online after a 122-day process. Not content with its existing capabilities, Musk stated, “over the next couple of months, it will double in size, bringing it to 200k (50k H200s).”

This weekend, the

This is the hidden content, please

• Sign In
• or
• Sign Up

team brought our Colossus 100k H100 training cluster online. From start to finish, it was done in 122 days.

Colossus is the most powerful AI training system in the world. Moreover, it will double in size to 200k (50k H200s) in a few months.

Excellent…

— Elon Musk (@elonmusk)

This is the hidden content, please

• Sign In
• or
• Sign Up

The scale of Colossus is unprecedented, surpassing every other cluster to date. For context,

This is the hidden content, please

• Sign In
• or
• Sign Up

uses 90,000 GPUs while OpenAI utilises 80,000 GPUs—both of which have been surpassed by xAI’s creation, even prior to Colossus’ doubling in size over the coming months.

Here is a comparison chart to help everyone understand the magnitude of this.

This is the hidden content, please

• Sign In
• or
• Sign Up

— Anthony Everywhere (@AnthonyEveryWhr)

This is the hidden content, please

• Sign In
• or
• Sign Up

Developed in partnership with Nvidia, Colossus leverages some of the most advanced GPU technology on the market. The system initially employs Nvidia’s

This is the hidden content, please

• Sign In
• or
• Sign Up

chips, with plans to incorporate the newer

This is the hidden content, please

• Sign In
• or
• Sign Up

model in its expansion. This vast array of processing power positions Colossus as the most formidable AI training system currently available.

The H200, while recently superseded by Nvidia’s Blackwell chip

This is the hidden content, please

• Sign In
• or
• Sign Up

in March 2024, ******** a highly sought-after component in the AI industry. It boasts impressive specifications, including 141 GB of HBM3E memory and 4.8 TB/sec of bandwidth. However, the Blackwell chip raises the bar even further, with top-end capacity 36.2% higher than the H200 and a 66.7% increase in total bandwidth.

Nvidia’s response to the Colossus unveiling was one of enthusiasm and support. The company congratulated Musk and the xAI team on their achievement, highlighting that Colossus will not only be the most powerful system of its kind but will also deliver “exceptional gains” in energy efficiency.

Exciting to see Colossus, the world’s largest GPU

This is the hidden content, please

• Sign In
• or
• Sign Up

, come online in record time. Colossus is powered by

This is the hidden content, please

• Sign In
• or
• Sign Up

's

This is the hidden content, please

• Sign In
• or
• Sign Up

platform, delivering breakthrough performance with exceptional gains in

This is the hidden content, please

• Sign In
• or
• Sign Up

.

Congratulations to the entire team!

This is the hidden content, please

• Sign In
• or
• Sign Up

— NVIDIA Data Center (@NVIDIADC)

This is the hidden content, please

• Sign In
• or
• Sign Up

Colossus’ processing power could potentially accelerate breakthroughs in various AI applications, from natural language processing to complex problem-solving algorithms. However, the unveiling of Colossus also reignites discussions about the concentration of AI power among a handful of tech giants and well-funded startups.

As companies like xAI push the boundaries of what’s possible in AI training, concerns about the accessibility of such advanced technologies to smaller organisations and researchers may come to the forefront.

As the AI arms race continues to heat up, all eyes will be on xAI and its competitors to see how they leverage these increasingly powerful systems. With Colossus, Musk and his team have thrown down the gauntlet and issued a challenge to rivals to match or exceed their efforts.

See also:

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up

Want to learn more about AI and big data from industry leaders? Check out

This is the hidden content, please

• Sign In
• or
• Sign Up

taking place in Amsterdam, California, and London. The comprehensive event is co-located with other leading events including

This is the hidden content, please

• Sign In
• or
• Sign Up

,

This is the hidden content, please

• Sign In
• or
• Sign Up

,

This is the hidden content, please

• Sign In
• or
• Sign Up

, and

This is the hidden content, please

• Sign In
• or
• Sign Up

.

Explore other upcoming enterprise technology events and webinars powered by TechForge

This is the hidden content, please

• Sign In
• or
• Sign Up

.

The post

This is the hidden content, please

• Sign In
• or
• Sign Up

appeared first on

This is the hidden content, please

• Sign In
• or
• Sign Up

.

This is the hidden content, please

• Sign In
• or
• Sign Up