Google has acknowledged that platforms like TikTok and Instagram are encroaching on its core Search product, particularly among younger Gen Z users. To address this, Google plans to enhance its search functionality with an emphasis on video, leveraging the capabilities of Gemini AI. Announced at the Google I/O developer conference on Tuesday, the company will soon allow users to conduct searches by uploading a video and pairing it with a text query to receive a comprehensive AI-generated overview of the information they seek.
Initially, this feature will be rolled out as an experimental offering within Search Labs for U.S. users, specifically in English.
This multimodal approach expands on an existing feature that enables users to combine text with visual searches. Launched in 2021, the option to search using both photos and text has already proven beneficial for scenarios in which visual elements are challenging to articulate or can be described in multiple ways. For instance, Google previously demonstrated that users could upload a photo of a shirt they like and use Google Lens to find the same pattern on different items, such as socks.
By introducing video search capabilities, Google is adapting to the ways in which users, especially younger demographics, engage with their smartphones. These users frequently capture videos rather than photos and often express their creativity through video content. Hence, it is logical for them to utilize video when conducting searches as well.
The new feature enables users to upload a video and pose a question, forming a comprehensive search query. In a live demonstration, Google illustrated this capability using a video of a malfunctioning record player, whose arm would not remain in place on the record. The query comprised a video showcasing the issue, accompanied by the question, “Why will this not stay in place?” Gemini, Google’s AI, then meticulously analyzes the video frame-by-frame to comprehend the context and subsequently provides an AI-generated summary of potential solutions.
For users seeking more in-depth information, there are options to access discussion forums or watch instructional videos on how to rebalance the turntable’s arm.
While this advanced video content analysis was demonstrated in conjunction with Google Search queries, its applications extend beyond this, including interpreting videos stored on your phone, uploaded to private cloud services like Google Photos, or shared publicly on platforms like YouTube.
Google has not disclosed the duration for which this new feature will remain in testing within the United States or its timeline for a global rollout.
