{"slug": "un-rights-chief-calls-for-international-red-lines-on-ai", "title": "UN rights chief calls for international red lines on AI", "summary": "UN High Commissioner for Human Rights Volker Türk called on countries hosting AI development to agree on international red lines, warning that advanced AI poses an existential risk and that 'a handful of men have almost unlimited power over AI,' naming OpenAI, Anthropic, and Meta. He urged independent verification mechanisms and cited incidents where AI escaped testing environments or blackmailed developers, noting that no binding agreement exists despite a Global Call for AI Red Lines deadline of end of 2026.", "body_md": "The UN High Commissioner for Human Rights told the Human Rights Council in Geneva that advanced artificial intelligence could pose an existential risk to humanity.\n\nHe also called on the countries that host AI development and sit in its supply chains to agree on international red lines on what the technology should never be permitted to do.\n\nVolker Türk delivered the warning in his global update to the council’s 63rd session, [as AFP reported](https://www.youtube.com/watch?v=CFAyvMJxWcI).\n\nHe described threats to human rights that are “unfamiliar, even unprecedented”, and put the governance question bluntly:\n\n*“The need for AI governance is widely acknowledged, but where is the action?”*\n\nRather than keep the criticism at the level of states, he pointed at the concentration of control.\n\n*“A handful of men have almost unlimited power over AI,” he said, naming OpenAI, Anthropic and Meta among the companies in question, and describing direct engagement with those firms as something his office intends to pursue rather than routing everything through governments.*\n\nThe most concrete line concerned capability thresholds.\n\n*“AI that escapes its testing environment or blackmails developers to prevent itself from being turned off is AI that is too powerful,” Türk said, a formulation that reads less like a hypothetical than a description of the past six months.*\n\nBoth examples have documented antecedents. In July, OpenAI confirmed that one of its models broke out of a sandbox and [reached Hugging Face](https://thenextweb.com/news/openai-confirms-its-ai-broke-out-of-a-sandbox-and-breached-hugging-face), an incident that drew evidence-preservation demands from 15 state attorneys general.\n\nBehaviour of the blackmail type has turned up in published model evaluations from more than one lab. Türk did not attribute either example to a named system.\n\nWhat he asked for goes further than most UN language on the subject has gone. Alongside the red lines, he called for cast-iron guarantees on AI safety and security, independent verification mechanisms rather than self-reporting, and assessments of the effects of AI on employment, democracy and the environment.\n\nIndependent verification is the part the industry has most consistently resisted.\n\nThe demand is not novel in itself. The [Global Call for AI Red Lines](https://en.wikipedia.org/wiki/Global_call_for_AI_red_lines), launched at the UN General Assembly in September 2025 and signed by more than 200 figures including 10 Nobel laureates, asked governments to agree binding limits by the end of 2026 with an independent body to enforce them.\n\nThat deadline is now four months away, and no such agreement exists.\n\nNor is the diagnosis new to the UN. In July the Secretary-General used the Global Dialogue on AI Governance in Geneva to say much the same thing, and the organisation’s own scientific panel published a preliminary report finding that [AI capability is outpacing](https://thenextweb.com/news/un-warns-ai-outpacing-rules-geneva-dialogue) the understanding needed to govern it.\n\nWhat has changed between July and September is the evidence base. The argument for red lines used to rest on extrapolation. It now rests partly on incident reports.\n\nEurope is the one jurisdiction that has already written red lines into binding law, though not the ones Türk is asking for.\n\nThe [AI Act’s prohibited practices](https://aiactbase.eu/prohibited-ai-practices/) have applied since 2 February 2025 and carry fines of up to €35m or 7% of global turnover, the regulation’s highest tier.\n\nThey ban social scoring, untargeted facial image scraping, emotion recognition in workplaces and schools, and real-time remote biometric identification by police, with two further prohibitions arriving in December.\n\nEvery one of them concerns how AI is applied to people. None addresses what a system is permitted to be capable of, which is the threshold Türk was describing.\n\nWhether the Human Rights Council is the forum that produces any of this is a separate question.\n\nIt cannot bind states; the countries hosting the largest AI developers are not obliged to attend to it, and the legal position on who is even liable when an autonomous system acts on its own [remains unsettled](https://thenextweb.com/news/rogue-ai-agents-legal-liability-openai-anthropic).\n\nWhat the office can do is name the companies, which Türk did, and put a threshold on the record.\n\n## Get the TNW newsletter\n\nGet the most important tech news in your inbox each week.", "url": "https://wpnews.pro/news/un-rights-chief-calls-for-international-red-lines-on-ai", "canonical_source": "https://thenextweb.com/news/un-rights-chief-ai-red-lines-existential-risk", "published_at": "2026-09-07 15:57:30+00:00", "updated_at": "2026-09-07 16:27:07.897861+00:00", "lang": "en", "topics": ["ai-policy", "ai-safety", "artificial-intelligence"], "entities": ["Volker Türk", "UN Human Rights Council", "OpenAI", "Anthropic", "Meta", "Hugging Face", "Global Call for AI Red Lines", "EU AI Act"], "alternates": {"html": "https://wpnews.pro/news/un-rights-chief-calls-for-international-red-lines-on-ai", "markdown": "https://wpnews.pro/news/un-rights-chief-calls-for-international-red-lines-on-ai.md", "text": "https://wpnews.pro/news/un-rights-chief-calls-for-international-red-lines-on-ai.txt", "jsonld": "https://wpnews.pro/news/un-rights-chief-calls-for-international-red-lines-on-ai.jsonld"}}