Google on Thursday announced a major update to Search, introducing AI-powered features aimed at expanding how users find information and explore new interests.
Gemini: Powering Search
Google emphasized that the latest advancements will allow users to ask questions in various ways—through text, voice, images, or even humming a tune.
The improvements are driven by Google’s Gemini model, specifically designed for Search, and have enhanced users’ ability to discover more online and in the world around them.
According to Google, AI Overviews have increased both usage and user satisfaction, while Google Lens handles nearly 20 billion visual searches every month, helping users search using their cameras or screens.
Key Features of the Update: Google Search Lens
Video Understanding in Lens: Google has expanded Lens’s capabilities to include video. Users can now record a video and ask questions about moving objects in it.
For example, at an aquarium, users can record fish swimming and ask, “Why are they swimming together?” Google’s systems will generate an AI Overview and provide relevant information from the web.
Voice Queries in Lens: Users can now ask questions using their voice while taking photos with Lens. Simply hold down the camera shutter, ask a question aloud, and Google will respond with relevant insights.
Improved Lens Shopping: Google has enhanced shopping features in Lens by providing more detailed results, including reviews, price comparisons, and where to buy items.
This is powered by Google’s Shopping Graph, which contains data on over 45 billion products. For instance, users can take a picture of a backpack, and Lens will provide detailed information about where to purchase it.
Song Identification with Circle to Search: Users can now instantly identify songs playing in videos or websites without switching apps. This feature, now part of Google’s Circle to Search, is available on over 150 million Android devices.
AI-Organized Search Results: Google has started organizing search results with AI for open-ended questions, beginning with recipes and meal ideas on mobile. This update allows users to explore content from various sources, such as articles, videos, and forums, all in one organized page.
New AI Overview Design: To make it easier to access relevant information, Google has updated its AI Overviews to include more prominent links to supporting websites within the overview text. This new design, which is rolling out globally, has already increased traffic to websites during testing.
Ads in AI Overviews: Google is introducing ads into AI Overviews for relevant searches, starting in the U.S. This feature aims to help users quickly connect with businesses, products, and services relevant to their queries.
Availability
- Video Understanding in Lens: Available globally for Android and iOS Search Labs users in the “AI Overviews and more” experiment, supporting English queries.
- Voice Queries in Lens: Available globally in the Google app for Android and iOS, supporting English queries.
- AI-Organized Search Results: Rolling out in the U.S. for recipe and meal inspiration searches on mobile this week.
- New AI Overview Design: Rolling out globally in all countries where AI Overviews are available.
- Ads in AI Overviews: Ads for relevant queries in AI Overviews will be available in the U.S. starting this week.
Speaking about the new updates, Liz Reid, VP, Head of Google Search, said –
Whether it’s searching with text, voice, images, or audio, we’ve always aimed to expand the ways people can ask questions on Google. With AI, we’re continuing to rethink how Search can quickly deliver the information you need, and we’re excited to bring these experiences to even more users globally.