Particle.news

Anthropic’s Claude Can Now Learn Tasks From Live Screen Walkthroughs

Promising faster desktop automation for paid users, the feature raises enterprise questions about verification and job risk.

Overview

  • Anthropic rolled out a “Record a Skill” tool in the Claude desktop app that records a live walkthrough of screen actions, mouse movements, keystrokes, and spoken commentary and then converts that demonstration into a reusable skill.
  • The capability is available only to paid Claude plans (Pro, Max, and Team) and runs in the desktop/Cowork environment where Claude must be active and granted screen permissions to capture a session.
  • Anthropic announced the feature on Tuesday, July 21, and the system demonstrably converts live demonstrations into automatable tasks that Claude can run on demand.
  • Claims that Claude can learn from offline or pre-recorded video have not been independently verified, and early users report practical limits such as high resource/token use and cooldowns that restrict how often skills can be created or run.
  • The update places Anthropic in direct competition with recent record-and-replay tools from rivals and prompts wider questions for businesses about auditability, verifiable logs of agent actions, and potential job displacement from automated desktop workflows.