Is GPT-5 in trouble? Report suggests that AI has plateaued

[Pelican Press 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

Is GPT-5 in trouble? Report suggests that AI has plateaued

Viralyft / Unsplash

OpenAI’s next-generation Orion model of ChatGPT, which is both rumored and

This is the hidden content, please

• Sign In
• or
• Sign Up

to be arriving by the end of the year, may not be all it’s been hyped to be once it arrives, according to a new report from

This is the hidden content, please

• Sign In
• or
• Sign Up

.

Citing anonymous OpenAI employees, the report claims the Orion model has shown a “far smaller” improvement over its GPT-4 predecessor than GPT-4 showed over GPT-3. Those sources also note that Orion “isn’t reliably better than its predecessor [GPT-4] in handling certain tasks,” specifically coding applications, though the new model is notably stronger at general language capabilities, such as summarizing documents or generating emails.

The Information’s report cites a “dwindling supply of high-quality text and other data” on which to train new models as a major factor in the new model’s insubstantial gains. In short, the AI industry is quickly running into a training data bottleneck, having already stripped the easy sources of social media data from sites like X,

This is the hidden content, please

• Sign In
• or
• Sign Up

, and

This is the hidden content, please

• Sign In
• or
• Sign Up

 (the latter on two

This is the hidden content, please

• Sign In
• or
• Sign Up

.) As such, these companies are increasingly having difficulty finding the sorts of knotty coding challenges that will help advance their models beyond their current capabilities, slowing down their pre-release training.

That reduced training efficiency has massive ecological and commercial implications. As frontier-class LLMs grow and further push their parameter counts into the high trillions, the amount of energy, water, and other resources

This is the hidden content, please

• Sign In
• or
• Sign Up

. This is why we’re seeing

This is the hidden content, please

• Sign In
• or
• Sign Up

,

This is the hidden content, please

• Sign In
• or
• Sign Up

, and

This is the hidden content, please

• Sign In
• or
• Sign Up

purchase the output of seven nuclear reactors, all to provide the necessary power for their growing menageries of AI data centers — the nation’s current power infrastructure simply can’t keep up.

In response,

This is the hidden content, please

• Sign In
• or
• Sign Up

, OpenAI has created a “foundations team” to circumvent the lack of appropriate training data. Those techniques could involve using synthetic training data, such as what

This is the hidden content, please

• Sign In
• or
• Sign Up

can generate. The team is also looking into improving the model’s performance post-training.

Orion, which was originally thought to be the code name for OpenAI’s GPT-5, is now expected to arrive at some point in 2025. Whether we’ll have enough available power to see it in action, without browning out our municipal electrical grids, ******** to be seen.

This is the hidden content, please

• Sign In
• or
• Sign Up

#GPT5 #trouble #Report #suggests #plateaued

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up