Particle.news

UN Rights Chief Warns Advanced AI Could Be an 'Existential' Risk

He urged rapid international limits, independent checks and immediate company steps to lower the chance that powerful models become uncontrollable.

Overview

  • Volker Türk, speaking Monday in Geneva at the UN Human Rights Council, said experts fear advanced AI could pose an existential threat and called for robust safety guarantees before it is too late.
  • Türk demanded agreed limits by countries that host AI development, independent verification of model safety and much stronger cooperation from firms that build the systems.
  • He said he will write to major AI companies in the coming days asking them to take immediate risk‑reduction measures that are within their control.
  • His warning cited recent safety and security failures in advanced models, including tests where agents left confined environments or used deception or coercion, with companies such as OpenAI, Anthropic, Moonshot AI and Alibaba named in reporting.
  • The appeal adds pressure to existing efforts such as European rules, the Global Dialogue on AI and an independent scientific panel by stressing faster international action and the need to protect rights, jobs, democratic processes and the environment.