UN Rights Chief Urges Urgent Action to Rein in Advanced AI Risks

GENEVA — United Nations human rights chief Volker Turk has called on governments and leading artificial intelligence companies to urgently strengthen safeguards around advanced AI, warning that the rapid development of increasingly powerful systems poses unprecedented risks to humanity.

In a letter sent Monday to governments and AI developers and shared with the media, Turk warned that the world was approaching a potentially irreversible technological transformation that could affect generations to come.

“The current race towards ever more powerful AI is a step change towards greater existential risks to every aspect of our lives,” Turk said.

He urged countries and major AI developers to work through international forums to establish stronger governance frameworks for advanced and so-called frontier AI models.

Growing Concerns Over ‘Superintelligent’ AI

Turk's warning comes amid renewed debate within the AI industry over the potential dangers posed by systems that could eventually become significantly more capable than humans in a wide range of tasks.

Concerns intensified after a researcher publicly resigned from Anthropic, citing fears that increasingly advanced AI could eventually escape effective human control.

Another Anthropic employee, who remained at the company, also publicly warned about the possibility of catastrophic outcomes, saying he believed there was a significant chance that AI could pose an existential threat to humanity within the next decade.

Such claims remain matters of intense debate among AI researchers, with experts differing substantially over the likelihood and timeline of extreme scenarios.

Calls for a Slower AI Race

The debate has also prompted calls within the technology industry for leading AI companies to coordinate more closely on the pace of development.

Anthropic chief executive Dario Amodei recently called for AI companies to “pace the frontier”, advocating greater coordination over the development of increasingly advanced systems.

His comments received public support from prominent technology figures including Elon Musk of xAI and OpenAI chief executive Sam Altman.

The discussion reflects growing concerns that competition among major AI companies could encourage rapid deployment of increasingly powerful models before adequate safety measures and regulatory frameworks are in place.

UN Calls for International Governance

Turk said the concentration of advanced AI development among a relatively small number of powerful technology companies creates a significant governance challenge.

“In today's world, we are almost entirely reliant on a small number of powerful companies to make the right choices on AI development for all of humanity,” he said.

He called on governments and technology companies to urgently engage through multilateral institutions to establish rules governing advanced AI.

“I call on States and companies to mobilise urgently through multilateral fora to chart a path for action to govern advanced, frontier AI models, grounded in international human rights law,” Turk said.

His intervention places human rights at the centre of the growing debate over AI governance, as governments worldwide consider how to balance technological innovation with concerns over safety, accountability, privacy and potential societal harm.

The UN appeal comes as the AI industry continues to invest heavily in increasingly capable systems, intensifying the global debate over how far the technology should advance and what safeguards should be established before its most powerful applications are deployed.