Jump to content
  • Sign Up
×
×
  • Create New...

Google Cloud launches first Blackwell AI GPU-powered instances — 72-way GB200 with 72 B200 GPUs and 36 Grace CPUs


Recommended Posts

  • Diamond Member

This is the hidden content, please

This is the hidden content, please
Cloud launches first Blackwell AI GPU-powered instances — 72-way GB200 with 72 B200 GPUs and 36 Grace CPUs

ENzqLjbjnBzZSo7uHQGEEb.jpg

This is the hidden content, please
has introduced its A4X virtual machines, which are powered by Nvidia’s GB200-based NVL72 machines. These rack-scale systems feature 72 B200 GPUs and 36 Grace CPUs. According to
This is the hidden content, please
, the new VMs are designed for large-scale AI workloads, such as large language models with long context windows, reasoning models, and scenarios that require massive concurrency.
This is the hidden content, please
also offers A4 VMs for general AI training and development.

This is the hidden content, please
’s A4X VMs leverage Nvidia’s NVL72 machines, which have 72 B200 GPUs and 36 72-core Grace CPUs (2,596 Armv9-based Neovers V2 cores) interconnected with NVLinks. This enables seamless memory sharing across all 72 GPUs, improving response times and inference accuracy. The system also supports concurrent inference requests, making it suitable for multimodal AI applications.

Performance-wise, A4X VMs deliver four times the training efficiency of previous A3 VMs that used Nvidia’s H100 GPUs. In particular,

This is the hidden content, please
Cloud promises ‘over 1 ExaFLOPS’ of computing power per GB200 NVL72 system, potentially producing 1440 FP8/INT8/FP6 PetaFLOPS performance, suitable for training and inference with concurrent workloads.

A4X VMs also feature the Titanium ML network adapters built on Nvidia’s ConnectX-7 NICs to ensure fast, secure, and scalable ML performance as it enables 28.8 terabits per second (72 × 400 Gbps) of uninterrupted low-latency GPU-to-GPU traffic using RoCE.

This is the hidden content, please
Cloud’s Jupiter network fabric connects NVL72 domains between each other, enabling seamless scaling to tens of thousands of Blackwell GPUs in a non-blocking cluster. In particular, AI teams can deploy A4X VMs via
This is the hidden content, please
Kubernetes Engine (GKE), which supports clusters of up to 65,000 nodes.
This is the hidden content, please
also touts advanced sharing and pipelining techniques to maximize GPU utilization for large deployments.

A4X VMs also seamlessly integrate with

This is the hidden content, please
Cloud services.
This is the hidden content, please
supports Cloud Storage FUSE, which improves training data throughput by 2.9 times, while Hyperdisk ML accelerates model load times by 11.9 times.

This is the hidden content, please
Cloud now offers both A4 and A4X VMs, each optimized for different AI workloads. A4X, with GB200 NVL72 systems, is aimed at large-scale AI, long-context language models, and high-concurrency applications. At the same time, A4, powered by B200 GPUs and unknown processors, is better suited for general AI training and fine-tuning. The pricing of A4X and A4 is unknown.

Get Tom’s Hardware’s best news and in-depth reviews, straight to your inbox.



This is the hidden content, please

#

This is the hidden content, please
#Cloud #launches #Blackwell #GPUpowered #instances #72way #GB200 #B200 #GPUs #Grace #CPUs

This is the hidden content, please

This is the hidden content, please

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Unfortunately, your content contains terms that we do not allow. Please edit your content to remove the highlighted words below.
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Vote for the server

    To vote for this server you must login.

    Jim Carrey Flirting GIF

  • Recently Browsing   0 members

    • No registered users viewing this page.

Important Information

Privacy Notice: We utilize cookies to optimize your browsing experience and analyze website traffic. By consenting, you acknowledge and agree to our Cookie Policy, ensuring your privacy preferences are respected.