Google Search AI Can Now See, Read, and Answer Anything You Throw at It

Google is bringing a major update to AI Mode in Search, introducing new ways to interact with content across desktop and phones. The changes focus on image-based queries, file uploads, and real-time visual search, with several features rolling out over the coming weeks.

Desktop users can now ask complex questions about images in AI Mode, a feature that was previously limited to the Google app. In the coming weeks, PDF uploads will also be supported, allowing users to work with documents and receive AI-generated responses.

Google says the tool will analyze the document’s contents and cross-reference information from the web, providing relevant links for further reading. Support for additional file types is expected in the months ahead.

Canvas Comes to Google Search

Another new feature, Canvas, will allow users to build and refine plans across multiple sessions in a dynamic side panel. AI Mode will organize information progressively and can incorporate uploaded files to provide better context.

Canvas will initially launch in the US for participants in the AI Mode Labs experiment within the coming weeks.

Video Input for Search Live

Search Live, integrated with Google Lens, is adding video input support. Users can point their mobile camera at an object, ask questions, and receive AI-powered responses in real time.

This feature begins rolling out this week in the US for those enrolled in AI Mode Labs.

AI Mode in Chrome

Google is also enhancing Chrome integration. Users can now ask questions about any webpage or document directly from the browser using Lens and AI Mode. A new “Ask Google about this page” option will appear in the Chrome address bar.

After starting a query, AI Mode provides an AI Overview in a side panel, and users can continue the conversation with follow-up questions by selecting AI Mode or clicking “Dive deeper” in the overview.