ChatGPT already speaks. Soon it may see as well

[Pelican Press 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

ChatGPT already speaks. Soon it may see as well

OpenAI

ChatGPT’s Advanced Voice Mode, which allows users to converse with the chatbot in real time, could soon gain the gift of sight, according to code discovered in the platform’s latest beta build. While OpenAI has not yet confirmed the specific release of the new feature, code in the ChatGPT v1.2024.317 beta build spotted by

This is the hidden content, please

• Sign In
• or
• Sign Up

suggests that the so-called “live camera” could be imminently forthcoming.

OpenAI had first shown off Advanced Voice Mode’s vision capabilities for ChatGPT in May, when the feature was first launched in alpha. During a demo posted at the time, the system was able to identify that it was looking at a dog through the phone’s camera feed, identify the dog based on past interactions, recognize the dog’s ball, and associate the dog’s relationship to the ball (i.e. playing fetch).

The feature was an immediate hit with alpha testers as well. X user Manuel Sainsily employed it to great effect in answering verbal questions about his new kitten based on the camera’s video feed.

Trying

This is the hidden content, please

• Sign In
• or
• Sign Up

’s new Advanced Voice Mode that just got released in Alpha. It feels like face-timing a super knowledgeable friend, which in this case was super helpful — reassuring us with our new kitten. It can answer questions in real-time and use the camera as input too!

This is the hidden content, please

• Sign In
• or
• Sign Up

— Manuel Sainsily (@ManuVision)

This is the hidden content, please

• Sign In
• or
• Sign Up

Advanced Voice Mode was subsequently released in beta to Plus and Enterprise subscribers in September, albeit without its additional visual capabilities. Of course, that didn’t stop users from going wild in testing the feature’s vocal limits. Advanced Voice, “offers more natural, real-time conversations, allows you to interrupt anytime, and senses and responds to your emotions,”

This is the hidden content, please

• Sign In
• or
• Sign Up

.

The addition of digital eyes would certainly set Advanced Voice Mode apart from OpenAI’s primary competitors

This is the hidden content, please

• Sign In
• or
• Sign Up

and Meta, both of whom have in recent months introduced conversational features of their own.

Gemini Live may be able to speak more than 40 languages, but it cannot see the world around itself (at least until

This is the hidden content, please

• Sign In
• or
• Sign Up

) — nor can Meta’s Natural Voice Interactions, which debuted at the Connect 2024 event in September, use camera inputs.

This is the hidden content, please

• Sign In
• or
• Sign Up

#ChatGPT #speaks

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up