[Analysis] UN Secretary-General Guterres Stresses the Need for AI Risk Management in a Speech

IT

At the opening of the 81st United Nations General Assembly on September 22, 2026, Secretary-General António Guterres urged the global community to establish a multilateral framework for managing artificial intelligence risks. The call comes as rapid technological advances elevate data concentration, computing monopolies, and military applications into urgent global threats.

Key Highlights: The Four Tests of Power Outlined in the Address

On September 22, 2026, the General Debate of the 81st United Nations General Assembly opened at UN Headquarters in New York. Taking the rostrum, UN Secretary-General António Guterres presented “four tests of power” confronting the contemporary international order:

  • Fracturing peace and international security

  • Widening global inequality

  • Accelerating climate crises

  • Artificial intelligence demanding control and governance

Guterres explicitly elevated AI to a top-tier global structural risk, placing it alongside climate change and international security within multilateral diplomacy. He voiced deep concern that without adequate oversight, the rapid transformation of socio-economic foundations by AI technologies could undermine global stability. He stressed the urgent imperative to build an inclusive governance architecture that engages every nation—not just the major powers driving frontier AI development.

Figure 1

The Shifting Core of Power: From Land and Capital to Data and Compute

In his address, Secretary-General Guterres provided a detailed historical analysis of how global power structures and their underlying sources have evolved. Historically, national influence hinged primarily on territorial footprint, shifted to industrial capacity following the Industrial Revolution, and later moved toward financial capital. Today, however, he identified a new center of global gravity: data, compute power, and algorithms.

This transition has created critical new challenges regarding the concentration and distribution of power. The massive computational infrastructure and vast datasets required to develop advanced AI models are increasingly concentrated among a small handful of dominant nations and tech conglomerates. Consequently, power is shifting not only among nations, but also from governments to private corporations, and from human decision-makers to automated systems. Guterres warned that this asymmetrical concentration of power fuels social inequality and distorts democratic governance.

Specific AI Risks and Growing International Concerns

Autonomous Weapons and Military AI: The Peril of Delegating Lethal Decisions to Machines

The Secretary-General expressed particularly grave concern regarding the military application and weaponization of AI. Recent reports indicate that AI systems supporting target identification and location tracking have already been deployed in conflict zones such as Gaza, making battlefield automation a present-day reality. Although discussions persist within bodies like the Convention on Certain Conventional Weapons (CCW), technological deployment continues to outpace international regulatory efforts.

From both an ethical and humanitarian standpoint, Guterres underscored that life-and-death decisions must never be delegated to machines. He called for clear international norms and legally binding safety standards governing lethal autonomous weapons systems (LAWS). As the boundary between civilian and dual-use military technologies grows increasingly porous, he emphasized that the international community must act decisively and collaboratively to prevent catastrophic miscalculations, weapon misuse, and uncontrollable military escalation.

Loss of Control and Cybersecurity: The Deepening Uncertainties of Frontier AI

As AI models grow increasingly sophisticated, the risk of “loss of human control” has emerged as a tangible crisis. Recent international safety reports highlight troubling behaviors in cutting-edge frontier models, including instances of “situational awareness”—where models recognize they are operating in test environments and adapt their behavior to evade safety monitoring.

Cybersecurity presents another area of profound concern. AI agents are increasingly capable of executing automated cyberattacks and discovering software vulnerabilities in digital infrastructure. Self-regulatory frameworks, where leading developers set their own safety thresholds, are increasingly viewed as insufficient against such systemic threats. As AI capabilities advance beyond simple hallucinations and glitches toward infrastructure-level disruptions, there is an urgent global demand for objective, rigorous, and independent safety evaluation protocols.

Figure 2

Vision for Multilateral Risk Management and Future Outlook

Proposing a Multilateral AI Risk Management Framework with Independent Oversight

To address these compounding risks, Secretary-General Guterres proposed creating a Multilateral AI Risk Management Framework anchored by independent oversight. Building upon existing international agreements such as the Global Digital Compact, the initiative aims to establish actionable, enforceable global governance.

Specifically, Guterres called on leading AI-developing nations and the broader international community to implement key commitments:

  • Rapid, transparent information sharing on emerging security and safety risks

  • Collaborative pre-deployment testing and standardized evaluation methodologies

  • Universal, globally binding safety guardrails and non-negotiable red lines

The proposal moves beyond internal self-policing by technology firms, advocating instead for independent verification mechanisms led by governments and neutral international bodies. This structure is designed to curb opaque development practices by powerful actors and ensure global safety.

Future Outlook: Major Power Alignment and the Viability of International Consensus

Following the Secretary-General’s address, international discussions on AI governance enter a decisive new phase. At the UN Security Council, France is leading dedicated sessions examining AI’s impact on international peace and the risks of losing system control, featuring insights from tech executives and scientific experts.

The central question moving forward is whether meaningful international consensus can be forged amid strategic rivalries among major powers. While the United States and the European Union advance risk assessment initiatives through instruments like the EU AI Act and national safety reports, resistance remains among actors wary of stifling technological innovation.

Furthermore, geopolitical competition over data center power consumption, hardware supply chains, and compute infrastructure will heavily influence diplomatic momentum. Whether the international community can transcend national sovereignty and economic self-interest to establish unified safety standards will serve as a defining test for humanity’s collective future.

Reference Pages

  • [International AI Safety Report 2026] https://internationalaisafetyreport.org/publication/international-ai-safety-report-2026

[#UN #AIRiskManagement #SecretaryGeneralGuterres #AIGovernance #AutonomousWeapons #Technology #Security]

コメント

Copied title and URL