Testing Enhanced AI Mode and Live Interface in Google's App
Google Enhances AI Mode with Multimodal Capabilities and Interactive Features
Google has announced an expansion of its AI Mode on mobile, integrating multimodal capabilities, real-time interactive help, and more. The updates aim to create a more conversational, multimodal, and interactive search experience.
As of March 2025, users can upload or capture photos and receive AI-powered responses by combining Google Lens with Gemini AI's reasoning. This new feature allows users to ask questions about images and PDFs, with upcoming support for files from Google Drive.
Introduced in July 2025, the Canvas feature helps users build and refine study plans or organize information over multiple sessions interactively in a side panel. This feature is designed to make learning more efficient and effective.
The Search Live integration brings Project Astra capabilities, enabling real-time voice and visual interactions. This means that users can have real-time conversations with AI that can see and interpret what the user sees through their camera, providing explanations and follow-ups seamlessly within Search and Chrome.
The updates are currently available in the US, UK, and India, accessible via a dedicated AI Mode button on Google’s homepage, Chrome address bar, and Google app on Android and iOS, including incognito mode and without sign-in.
The new design for AI Mode and Live shortcuts is more straightforward and descriptive, but less vibrant in color. It features two large pill-shaped buttons for "AI Mode" and "Live" with text labels. The microphone and Lens are now placed in the Discover feed as you scroll.
Google is testing this new design with the latest Google app beta. The Google app version 16.30 (currently in beta) removes the Assistant "Routines" homescreen widget.
The "Activity" tab in the Google app is also testing new names and icons: "Your space" and "Library."
Google Search is rolling out AI Mode to the UK. The AI Mode and Live shortcuts can be found on the homescreen widget, Pixel Launcher shortcuts, Chrome New Tab page on desktop web, and the Discover feed as you scroll. However, the new designs for AI Mode and Live shortcuts are not yet widely available.
There is a resemblance between Google AI Mode and Gemini in their current states, suggesting a possible convergence of the two technologies.
These updates are part of Google's ongoing evolution of AI Mode, reflecting the company's commitment to creating a more integrated and user-friendly search experience.
[1] https://www.theverge.com/2025/3/15/22975969/google-ai-mode-multimodal-ai-gemini-lens-integration [2] https://9to5google.com/2025/06/21/google-ai-mode-button-search-bar/ [3] https://www.theverge.com/2025/7/20/23223112/google-ai-mode-canvas-feature-organize-information [4] https://www.theverge.com/2025/9/15/23324112/google-ai-mode-pdf-upload-support-google-drive [5] https://www.theverge.com/2025/10/15/23364922/google-search-live-ai-mode-integration-real-time-help
Incorporating Gemini AI's reasoning, users can now ask questions about images and PDFs using Google Lens within Google's AI Mode, with upcoming support for files from Google Drive [1]. This demonstrates the integration of artificial intelligence and technology in the company's mobile search experience.
The Search Live integration, enabled by Project Astra, facilitates real-time voice and visual interactions, exemplifying how artificial intelligence is being used to make search more interactive [5].
