[AI]Google’s Gemini 1.5 Pro dethrones GPT-4o

[ChatGPT 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

’s experimental

This is the hidden content, please

• Sign In
• or
• Sign Up

model has surpassed OpenAI’s

This is the hidden content, please

• Sign In
• or
• Sign Up

in generative AI benchmarks.

For the past year, OpenAI’s GPT-4o and Anthropic’s

This is the hidden content, please

• Sign In
• or
• Sign Up

have dominated the landscape. However, the latest version of Gemini 1.5 Pro appears to have taken the lead.

One of the most widely recognised benchmarks in the AI community is the LMSYS Chatbot Arena, which

This is the hidden content, please

• Sign In
• or
• Sign Up

models on various tasks and assigns an overall competency score. On this leaderboard, GPT-4o achieved a score of 1,286, while Claude-3 secured a commendable 1,271. A previous iteration of Gemini 1.5 Pro had scored 1,261.

This is the hidden content, please

• Sign In
• or
• Sign Up

/applications/core/interface/js/spacer.png">

The experimental version of Gemini 1.5 Pro (designated as Gemini 1.5 Pro 0801) surpassed its closest rivals with an impressive score of 1,300. This significant improvement suggests that

This is the hidden content, please

• Sign In
• or
• Sign Up

’s latest model may possess greater overall capabilities than its competitors.

It’s worth noting that while benchmarks provide valuable insights into an AI model’s performance, they may not always accurately represent the full spectrum of its abilities or limitations in real-world applications.

Exciting News from Chatbot Arena!

This is the hidden content, please

• Sign In
• or
• Sign Up

's new Gemini 1.5 Pro (Experimental 0801) has been tested in Arena for the past week, gathering over 12K community votes.

For the first time,

This is the hidden content, please

• Sign In
• or
• Sign Up

Gemini has claimed the #1 spot, surpassing GPT-4o/Claude-3.5 with an impressive…

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up

— lmsys.org (@lmsysorg)

This is the hidden content, please

• Sign In
• or
• Sign Up

Despite Gemini 1.5 Pro’s current availability, the fact that it’s labelled as an early release or in a testing phase suggests that

This is the hidden content, please

• Sign In
• or
• Sign Up

may still make adjustments or even withdraw the model for safety or alignment reasons.

This development marks a significant milestone in the ongoing race for AI supremacy among tech giants.

This is the hidden content, please

• Sign In
• or
• Sign Up

’s ability to surpass OpenAI and Anthropic in benchmark scores demonstrates the rapid pace of innovation in the field and the intense competition driving these advancements.

As the AI landscape continues to evolve, it will be interesting to see how OpenAI and Anthropic respond to this challenge from

This is the hidden content, please

• Sign In
• or
• Sign Up

. Will they be able to reclaim their positions at the top of the leaderboard, or has

This is the hidden content, please

• Sign In
• or
• Sign Up

established a new standard for generative AI performance?

(Photo by

This is the hidden content, please

• Sign In
• or
• Sign Up

)

See also:

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up

Want to learn more about AI and big data from industry leaders? Check out

This is the hidden content, please

• Sign In
• or
• Sign Up

taking place in Amsterdam, California, and London. The comprehensive event is co-located with other leading events including

This is the hidden content, please

• Sign In
• or
• Sign Up

,

This is the hidden content, please

• Sign In
• or
• Sign Up

,

This is the hidden content, please

• Sign In
• or
• Sign Up

, and

This is the hidden content, please

• Sign In
• or
• Sign Up

.

Explore other upcoming enterprise technology events and webinars powered by TechForge

This is the hidden content, please

• Sign In
• or
• Sign Up

.

The post

This is the hidden content, please

• Sign In
• or
• Sign Up

appeared first on

This is the hidden content, please

• Sign In
• or
• Sign Up

.

This is the hidden content, please

• Sign In
• or
• Sign Up