Apple says its AI models were trained on Google’s custom chips

[Pelican Press 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

Apple says its AI models were trained on

This is the hidden content, please

• Sign In
• or
• Sign Up

’s custom chips

This is the hidden content, please

• Sign In
• or
• Sign Up

CEO Sundar Pichai (L) and Apple CEO Tim Cook (R) listen as U.S. President Joe Biden speaks during a roundtable with ********* and Indian business leaders in the East Room of the White House in Washington, D.C., on June 23, 2023.

Anna Moneymaker | Getty Images

Apple said on Monday that the artificial intelligence models underpinning Apple Intelligence, its AI system, were pre-trained on processors designed by

This is the hidden content, please

• Sign In
• or
• Sign Up

, a sign that big tech companies are looking for alternatives to Nvidia when it comes to the training of cutting-edge AI.

Apple’s choice of

This is the hidden content, please

• Sign In
• or
• Sign Up

’s homegrown Tensor Processing Unit (TPU) for training was detailed in

This is the hidden content, please

• Sign In
• or
• Sign Up

the company. Separately, Apple released a preview version of Apple Intelligence for some devices on Monday.

Nvidia’s pricey graphics processing units (GPUs) dominate the market for high-end AI training chips, and have been in such high demand over the past couple years that they’ve been difficult to procure in the quantities needed. OpenAI,

This is the hidden content, please

• Sign In
• or
• Sign Up

, and Anthropic are all using Nvidia’s GPUs for their models, while other tech companies, including

This is the hidden content, please

• Sign In
• or
• Sign Up

, Meta, Oracle and Tesla are snapping them up to build out their AI systems and offerings.

Meta CEO Mark Zuckerberg and Alphabet CEO Sundar Pichai both made comments last week suggesting that their companies and others in the industry may be overinvesting in AI infrastructure, but acknowledged that the business risk to doing otherwise was too high.

“The downside of being behind is that you’re out of position for like the most important technology for the next 10 to 15 years,” Zuckerberg said on a 

This is the hidden content, please

• Sign In
• or
• Sign Up

with Bloomberg’s Emily Chang.

Apple doesn’t name

This is the hidden content, please

• Sign In
• or
• Sign Up

or Nvidia in its 47-page paper, but says that its Apple Foundation Model (AFM) and AFM server are trained on “Cloud TPU clusters.” That means Apple rented servers from a cloud provider to perform the calculations.

“This system allows us to train the AFM models efficiently and scalably, including AFM-on-device, AFM-server, and larger models,” Apple said in the paper.

Representatives for Apple and

This is the hidden content, please

• Sign In
• or
• Sign Up

didn’t respond to requests for comment.

data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///ywAAAAAAQABAAACAUwAOw==

Apple was later to reveal its AI plans than many of its peers, which loudly embraced generative AI soon after OpenAI’s launch of ChatGPT in late 2022. On Monday, Apple introduced Apple Intelligence. The system includes several new features, such as a refreshed look for Siri, better natural language processing, and AI-generated summaries in text fields.

Over the next year, Apple plans to roll out functions based on generative AI, including image generation, emoji generation, and a powered-up Siri that can use the user’s personal information and take actions inside of apps.

In Monday’s paper, Apple said that AFM on-device was trained on a single “slice” of 2048 TPU v5p chips working together. That’s the most advanced TPU, first launched in December. AFM-server was trained on 8192 TPU v4 chips that were configured to work together as eight slices through a data center network, according to the paper.

This is the hidden content, please

• Sign In
• or
• Sign Up

’s latest TPUs cost under $2 per hour the chip is in use when booked for three years in advance, according

This is the hidden content, please

• Sign In
• or
• Sign Up

.

This is the hidden content, please

• Sign In
• or
• Sign Up

first introduced its TPUs in 2015 for internal workloads, and made them available to the public in 2017. They’re now among the most mature custom chips designed for artificial intelligence.

Still,

This is the hidden content, please

• Sign In
• or
• Sign Up

is one of Nvidia’s top customers.

This is the hidden content, please

• Sign In
• or
• Sign Up

uses Nvidia’s GPUs and its own TPUs for training AI systems, and also sells access to Nvidia’s technology on its cloud.

Apple previously said that inferencing, which means taking a pre-trained AI model and running it to generate content or make predictions, would partially happen on Apple’s own chips in its data centers.

This is the second technical paper about Apple’s AI system, after a more general version was published in June. Apple said

This is the hidden content, please

• Sign In
• or
• Sign Up

that it was using TPUs as it developed its AI models.

Apple is scheduled to report quarterly results after the close of trading on Thursday.

WATCH: How the massive power draw of generative AI is overtaxing our grid

data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///ywAAAAAAQABAAACAUwAOw==

This is the hidden content, please

• Sign In
• or
• Sign Up

#Apple #models #trained #Googles #custom #chips

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up