Particle.news
Download on the App Store

Microsoft Puts Copilot at the Center of Windows 11 With Voice, Vision and Early Agent Actions

Initial access is limited to Windows Insiders with agent capabilities requiring explicit permission under isolation controls.

Overview

  • Copilot Voice enables hands-free activation with the phrase “Hey Copilot,” and the assistant is surfaced on the Windows 11 taskbar as an optional feature.
  • Copilot Vision can see the user’s screen to analyze content and guide tasks inside apps, with global expansion underway and text-based interaction entering Insider testing.
  • New Copilot Actions let the AI perform tasks in local files and desktop or web apps in a limited preview, such as organizing photos, extracting PDF data or booking reservations under user supervision.
  • Copilot Connectors link Microsoft services like OneDrive and Outlook Calendar with Google services including Drive, Gmail and Calendar to pull relevant information within the Copilot app.
  • Gaming Copilot debuts for supported NPU devices such as the ROG Xbox Ally, offering in-game assistance and AI-driven enhancements without leaving the session.