Apple, Anthropic and Other AI Firms Have Reportedly Trained AI Models on Thousands of YouTube Videos

[Pelican Press 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

Apple, Anthropic and Other AI Firms Have Reportedly Trained AI Models on Thousands of

This is the hidden content, please

• Sign In
• or
• Sign Up

Videos

Apple, Anthropic, and other major artificial intelligence (AI) firms have reportedly trained AI models on data from hundreds of thousands of

This is the hidden content, please

• Sign In
• or
• Sign Up

videos. A new report claims that multiple AI companies used a publicly available dataset called Pile which contained the plain text of videos’ subtitles without any video imagery. The data was collected from popular

This is the hidden content, please

• Sign In
• or
• Sign Up

creators such as MrBeast, Marques Brownlee, and PewDiePie as well as Indian

This is the hidden content, please

• Sign In
• or
• Sign Up

creators such as CarryMinati, BB ki Vines, and Ashish Chanchlani.

Multiple AI Models Reportedly Trained on

This is the hidden content, please

• Sign In
• or
• Sign Up

Videos

Proof News conducted an

This is the hidden content, please

• Sign In
• or
• Sign Up

to find that subtitles data from as many as 1,73,536

This is the hidden content, please

• Sign In
• or
• Sign Up

videos were taken from more than 48,000 channels. As per the report, EleutherAI, a non-profit AI research lab, curated this dataset. Later, it was used by companies such as Apple, Anthropic, Nvidia, Salesforce, and more. Notably, the AI lab published a research

This is the hidden content, please

• Sign In
• or
• Sign Up

highlighting the details of the dataset.

EleutherAI created a data repository of 800GB dubbed Pile and made it publicly available for those who wanted to train AI models but could not afford large datasets. The majority of the dataset was taken from publicly available sources such as English

This is the hidden content, please

• Sign In
• or
• Sign Up

, e-books, and more. However, it also contained the subtitles from all the videos compiled in a dataset called

This is the hidden content, please

• Sign In
• or
• Sign Up

Subtitles.

The report claimed that the Pile was used to train Apple’s OpenELM AI model, on the basis of the research paper’s description. Salesforce, Nvidia, and Anthropic’s AI models’ research papers also reportedly mention the usage of the dataset.

Anthropic spokesperson Jennifer Martinez told the publication in a statement, “The Pile includes a very small subset of

This is the hidden content, please

• Sign In
• or
• Sign Up

subtitles.

This is the hidden content, please

• Sign In
• or
• Sign Up

’s terms cover direct use of its platform, which is distinct from use of the Pile dataset. On the point about potential violations of

This is the hidden content, please

• Sign In
• or
• Sign Up

’s terms of service, we’d have to refer you to the Pile authors.”

Notably,

This is the hidden content, please

• Sign In
• or
• Sign Up

’s terms of service

This is the hidden content, please

• Sign In
• or
• Sign Up

anyone from accessing the videos on the platform using automated means such as robots, botnets or scrapers.

This is the hidden content, please

• Sign In
• or
• Sign Up

Subtitles will fall under the scraping category. A

This is the hidden content, please

• Sign In
• or
• Sign Up

spokesperson told Proof News in an email response that the tech giant has taken “action over the years to prevent abusive, unauthorised scraping.” However, no comments were made about AI firms’ usage of the data.

In a post on X (formerly known as

This is the hidden content, please

• Sign In
• or
• Sign Up

), Marques Brownlee called out Apple for sourcing data from companies that included his videos’ transcripts, but he also highlighted that it was not the iPhone maker’s fault since they did not collect the data.

Apple has sourced data for their AI from several companies

One of them scraped tons of data/transcripts from

This is the hidden content, please

• Sign In
• or
• Sign Up

videos, including mine

Apple technically avoids “fault” here because they’re not the ones scraping

But this is going to be an evolving problem for a long time

This is the hidden content, please

• Sign In
• or
• Sign Up

— Marques Brownlee (@MKBHD)

This is the hidden content, please

• Sign In
• or
• Sign Up

While this dataset was collected and distributed publicly, there could be other instances of data scraping on platforms such as

This is the hidden content, please

• Sign In
• or
• Sign Up

. With AI firms scrambling to find more data to train their large language models (LLMs), data procurement might continue to enter similar legally grey areas.

This is the hidden content, please

• Sign In
• or
• Sign Up

#Apple #Anthropic #Firms #Reportedly #Trained #Models #Thousands #

This is the hidden content, please

• Sign In
• or
• Sign Up

#Videos

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up