Particle.news

DeepMind Brings Gemini-Powered Pointer to Chrome, Previews Magic Pointer on Googlebook

The AI-aware cursor reads on-screen context to let people point and speak instead of writing long prompts.

Overview

  • DeepMind said Chrome now lets users point to a part of a webpage and ask Gemini about that exact spot.
  • Google published two demos in AI Studio that show point-and-speak controls for editing an image and finding places on a map.
  • The AI-enabled pointer captures visual and semantic context near the cursor to understand what matters on the screen.
  • DeepMind set four design principles that shift the job of supplying context from the user to the computer.
  • Google says a Magic Pointer will reach Googlebook laptops soon, extending the same in-place help beyond the browser.