Overview

• Windows will become ambient and multimodal, enabling users to interact through voice, vision, pen, touch, and keyboard.
• He described a context-aware system that can 'look at your screen' to interpret content and suggest semantically relevant actions without explicit commands.
• The operating system will shift toward an agentic model, proactively assisting with workflows through integrated AI agents rather than serving only as an overlay.
• Microsoft plans to roll out these capabilities via a hybrid compute approach that combines on-device neural processing units and cloud services, starting with Copilot enhancements on Windows 11 and Copilot Plus PCs.
• Davuluri acknowledged that powering these features will require balancing expanded data processing with robust privacy safeguards and transparent user controls.