At the Google I/O 2025 event, Google unveiled Project Astra, an innovative low-latency, multimodal AI system designed to enhance various applications such as Search, the Gemini AI app, and offerings from third-party developers. This initiative promises a more dynamic user experience by integrating real-time AI capabilities.
One of the standout features of Project Astra is the new “Search Live” capability in Google Search. When users engage with AI Mode or the Lens visual search feature, they can activate the “Live” option while using their smartphone’s camera to pose questions based on what they are viewing. Project Astra processes live video and audio feeds, providing prompt responses to user inquiries with minimal latency.
Initially showcased at Google I/O 2024 through a striking demo involving smart glasses, Project Astra emerged from Google DeepMind’s efforts to highlight near real-time multimodal AI functions. Google is working in collaboration with partners such as Samsung and Warby Parker to develop these smart glasses, although no specific release date has been announced. In the meantime, the company is rolling out several features powered by Project Astra for consumer and developer use.
For developers, Project Astra is enhancing the capabilities of its Live API, which now supports low-latency voice interactions with the Gemini system. This API update allows developers to create applications that utilise audio and visual inputs, along with native audio output, mirroring Project Astra’s functionalities. The new Live API also features improved emotion detection, enabling more nuanced and appropriate responses from the AI, along with advanced reasoning capabilities derived from Gemini’s models.
Additionally, users of the Gemini app are set to benefit from real-time video and screen-sharing features, which will now be accessible to all, transitioning from a previous model that required subscription. Project Astra already facilitates low-latency conversations in Gemini Live and will expand these visual functionalities to a broader audience.
Google appears optimistic that Project Astra represents a significant step forward for its products and has the potential to create an entirely new category of devices, like smart glasses. However, despite showcasing prototypes last year, the company has yet to announce a launch date and has provided only vague details about the design of these smart glasses, leaving their real-world availability unclear.
Overall, Project Astra signals an exciting evolution in how users interact with Google’s technology, promising faster, richer experiences through advanced AI integration.
Fanpage: TechArena.au
Watch more about AI – Artificial Intelligence
