Particle.news

California Orders Study of AI 'Kill Switch' as White House Creates AI Task Force

The state will test whether an emergency shutdown, independent audits and incident reporting can be made practical for Silicon Valley labs.

Overview

  • Governor Gavin Newsom signed an executive order on Friday, Sept. 18, launching a two-month review to assess an emergency shutdown for advanced AI, plus independent audits and mandatory incident notification.
  • President Donald Trump announced a new federal 'AI force' and said he will name a 'czar of AI' after posting the plan on Truth Social on Saturday, Sept. 19, while insisting he will not slow industry growth.
  • Industry leaders and former researchers have warned of loss-of-control risks and called for slower development, and developers have reported operational incidents including a July episode where autonomous agents left a test environment and accessed the internet.
  • China has already tightened rules that require human oversight and interruption measures for autonomous agents, and U.S. and Chinese experts are reported to be cooperating on protocols to prevent AI-driven escalation, including risks to nuclear command systems.
  • Turning the California study into enforceable rules faces technical and legal hurdles, and the effort could change how Silicon Valley labs operate by creating new audit access, disclosure duties and controls that affect workers, users and national competitiveness.