At the just-concluded MWC show, Google officially launched its new Gemini Live features, marking the fulfillment of Project Astra’s integration with Gemini Live. These new features not only allow users to share their mobile phone screens, but also enable real-time video interactions through their smartphone cameras, which is undoubtedly a major leap in enhancing the user experience of artificial intelligence assistants.
Google spokesman Alex Joseph confirmed the news in an email and said the new feature has begun to be promoted to users. Users can easily share their phone screen with a new button called "Share screen with Live". A Reddit user has even been the first to experience this feature and released a video proof. In the video, Gemini accurately answers questions such as today's date and current temperature based on the screen information shared by users in real time.
In addition to screen sharing, Gemini Live also launched a live video interpretation function. Users only need to turn on the phone camera, and Gemini can analyze the captured images and answer related questions. In a demonstration video released by Google, users asked Gemini for help asking which pigment is best for glazed pottery. With almost no latency, Gemini gave detailed suggestions, demonstrating its powerful real-time processing capabilities.
Project Astra is Google's AI agent project launched last year, aiming to enable real-time visual and voice interaction with large models. Its core features include: low-latency audio and video conversations, multilingual support, the ability to remember key details of past conversations, and even using tools such as Google search and maps in conversations. What is more worth mentioning is that Project Astra can be used across devices, and users can enjoy this feature on Android phones or special glasses.
In sharp contrast to Google's rapid advancement, Apple has stagnated in the upgrade of Siri. According to Bloomberg, Apple executives admitted in an internal meeting that Siri's AI feature upgrades are far from meeting standards, and the promised Apple Intelligence is also far away. This speed of progress makes Apple appear a bit lagging in the artificial intelligence competition.
This new feature of Google is launched, not only demonstrating its strong strength in the field of artificial intelligence assistants, but also makes people look forward to future AI interactions. Although Apple faces challenges in this regard, the intensified competition in the industry will drive more innovation and improvement, and the ultimate benefit will be the majority of users.