OpenAI, the creator of ChatGPT, has announced its latest AI model, GPT-4o, which is
OpenAI, the creator of ChatGPT, has announced its latest AI model, GPT-4o, a more human-like chatbot that can interpret a user’s audio and video and respond in real time.
A series of demos released by the company show that the GPT-4 Omni helps potential users with things like preparing for an interview — by making sure they look presentable for the interview — as well as contacting a customer service agent to get a replacement iPhone.
Other demos show that it can share dad jokes, translate a bilingual conversation in real-time, be a referee on a rock-paper-scissors match between two users, and respond with sarcasm when asked. One demo also shows how ChatGPT reacts when presented to a user’s puppy for the first time.
“Well, hello, Bowser!” Aren’t you just the most adorable little thing?” shouted the chatbot.
Say hello to GPT-4o, our new groundbreaking model that can reason through voice, vision and text in real time:
Text and image input is rolling out today in the API and ChatGPT with audio and video in the coming weeks. pic.twitter.com/uuthKZyzYx
– OpenAI (@OpenAI) May 13, 2024
“It’s like AI from the movies; “It’s still a bit surprising to me that this is real,” Sam Altman, the company’s CEO, said in a May 13 blog post.
“It turns out that reaching human-level response times and expression is a big change.”
The text and image input-only version launched on May 13, and the full version is scheduled to roll out in the coming weeks, OpenAI said in a recent X post.
GPT-4o will be available to paid and free ChatGPT users and can be accessed through the ChatGPT API.
The “o” in GPT-4o stands for “omni” — which seeks to define a step toward more natural human-computer interactions, OpenAI said.
Introducing GPT-4o, our new model that can reason over text, audio, and video in real time.
It’s versatile and fun to play with, and is a step towards a more natural form of human-computer (and even human-computer) interaction: pic.twitter.com/VLG7TJ1JQx
– Greg Brockman (@gdb) May 13, 2024
GPT-4o’s ability to process any text, audio, and image inputs at the same time is a major advance over OpenAI’s previous AI tools, like ChatGPT-4, which often “loses a lot of information” when forced to multitask. .
Related: Apple finalizes deal with OpenAI for ChatGPT iPhone integration: report
“GPT-4o is particularly better at understanding vision and sound than current models,” OpenAI said, which even includes capturing a user’s emotions and breathing patterns.
It is also “much faster” and “50% cheaper” than GPT-4 Turbo in the OpenAI API.
The new AI tool can respond to voice inputs in less than 2.3 seconds, with an average time of 3.2 seconds, OpenAI claims, which it says is similar to human response times in a normal conversation.
the magazine :How to Stop the AI Apocalypse: David Brin, author of Uplift
