With the OpenAI ChatGPT-4o launch led by Sam Altman on May 13, 2024 — right before the Google I/O event — many innovations arrived in the AI space. With vision, speech and text capabilities that come very close to real life, ChatGPT-4o looks like it has reached another level.

1. It will be able to reason across audio, text and images.
2. It will interpret the live feed from your camera in real time. For example, it will be able to describe the surroundings shown through the camera for visually impaired users.
3. It will do real-time translation. After this feature was shown, shares of the language-learning app Duolingo dropped sharply.
4. It will be able to read your emotions from your face through the camera. From the moment you turn the camera on, it can interpret everything.
5. With the desktop app and screen sharing, it will answer questions, interpret your screen and explain topics. For example, it will be able to help your kids with math problems.
6. It will be free. The reason is that they need a huge stream of data, so they will collect it through users by keeping it open to everyone.
7. I haven’t watched it myself, but after Sam Altman’s tweet, it seems we’ll all need to watch the movie “Her”, released in 2014.