Particle.news

Download on the App Store

Google AI Mode Adds Image-Based Search with Multimodal Capabilities

The update integrates Google Lens and Gemini AI, enabling users to upload images and ask complex questions, now available to millions more U.S. Labs users.

Google AI Mode Lens
Image
Image
Image

Overview

  • Google's AI Mode now supports multimodal search, combining Google Lens and Gemini AI to analyze and respond to image-based queries.
  • The feature allows users to upload photos, ask detailed questions about them, and receive nuanced, context-rich responses with links for further exploration.
  • Using a 'query fan-out' technique, AI Mode generates multiple sub-queries about an image and its objects to deliver comprehensive results.
  • Initially available only to Google One AI Premium subscribers, AI Mode's expanded access now includes millions of U.S. Labs users.
  • This enhancement positions Google to compete with AI search platforms like ChatGPT Search and Perplexity AI by offering more interactive and visually driven search capabilities.