Ex-Twitter dev reminisces about finding 700 unused Nvidia GPUs after takeover — forgotten cluster was ‘powered on and idle’

[Pelican Press 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

Ex-

This is the hidden content, please

• Sign In
• or
• Sign Up

dev reminisces about finding 700 unused Nvidia GPUs after takeover — forgotten cluster was ‘powered on and idle’

data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///ywAAAAAAQABAAACAUwAOw==

An engineer who worked at

This is the hidden content, please

• Sign In
• or
• Sign Up

during the seismic Agrawal-Musk transition has been publicly reminiscing about finding a cluster of 700 Nvidia V100 GPUs. Tim Zaman, who now works as a software engineer at

This is the hidden content, please

• Sign In
• or
• Sign Up

DeepMind, discovered this significant chunk of GPU power to be powered up but idle in the data center of X’s chirpy ancestor.

A few weeks post

This is the hidden content, please

• Sign In
• or
• Sign Up

-acquisition in 2022 we found 700 V100 gpus (pcie, lol) in the datacenter.They were powered on and idle, and had been for ages: the forgotten ******** of a honest attempt to make a cluster within

This is the hidden content, please

• Sign In
• or
• Sign Up

1.0.Haha how times have changed! 100k gpus on the… https://t.co/zSChG0BvVZ

This is the hidden content, please

• Sign In
• or
• Sign Up

The warm humming mass of Nvidia silicon and PCBs in the

This is the hidden content, please

• Sign In
• or
• Sign Up

data center was poetically described as “the forgotten ******** of an honest attempt to make a cluster within

This is the hidden content, please

• Sign In
• or
• Sign Up

1.0” by Zaman in a

This is the hidden content, please

• Sign In
• or
• Sign Up

/X post on Monday. The engineer had been spurred to write about his surprise discovery of this silicon treasure trove after reading about xAI’s Memphis Supercluster getting to work training Grok 3, powered by 100,000 liquid-cooled Nvidia H100 accelerators on a single RDMA fabric.

Zaman underlined what many of you will be thinking –

This is the hidden content, please

• Sign In
• or
• Sign Up

had 700 of the world’s most powerful GPUs humming along without purpose for years. “How times have changed!” he exclaimed. Indeed, the first Nvidia Volta architecture V100 GPUs for data centers started to arrive in the market during the first great GPU shortage of 2017, and Zaman found the 700x V100 card-powered cluster running without purpose in mid-2022. That’s a lot of computing time and resources wasted.

Another moment of mirth for Zaman was discovering that the 700 Nvidia V100s were PCIe GPUs rather than the far higher bandwidth NVLink interfaced SXM2 form factor variety. Of course, we don’t know why the 2017-era

This is the hidden content, please

• Sign In
• or
• Sign Up

bought PCIe instead of SXM2 bus V100 GPUs for this sizable installation, and perhaps we will never know.

Zaman’s Tweet also contained some interesting musings about Musk’s new ‘Gigafactory of Compute.’ Running “100k GPUs on the same fabric must be an epic challenge,” commented the engineer. “At that scale, the only guarantee is ********, and it’s all about graceful ******** management.” With this in mind, Zaman pondered over disaggregating resources into distinct domains so that failures wouldn’t bring the whole house down. 

The engineer also found the potential maximum number of GPUs that could exist on a single fabric fascinating. With tech titans racing to build ******* and ******* AI training clusters, both predictable and unforeseen limits on the maximum number of GPUs on the same fiber are bound to become known.

Get Tom’s Hardware’s best news and in-depth reviews, straight to your inbox.

This is the hidden content, please

• Sign In
• or
• Sign Up

#ExTwitter #dev #reminisces #finding #unused #Nvidia #GPUs #takeover #forgotten #cluster #powered #idle

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up

For verified travel tips and real support, visit: https://hopzone.eu/