US-China perspectives on extreme AI risks and global governance
This work informs policymakers and researchers about AI risk discourse in the US and China, potentially contributing to global governance discussions, but it is incremental as it synthesizes existing public information without new data or methods.
The study compiled public statements from US and Chinese experts to analyze their perspectives on extreme risks from advanced AI, such as AGI, finding that both countries express concerns about risks like intelligence explosions and loss of control, and have initiated early efforts for international cooperation on safety standards.
The United States and China will play an important role in navigating safety and security challenges relating to advanced artificial intelligence. We sought to better understand how experts in each country describe safety and security threats from advanced artificial intelligence, extreme risks from AI, and the potential for international cooperation. Specifically, we compiled publicly-available statements from major technical and policy leaders in both the United States and China. We focused our analysis on advanced forms of artificial intelligence, such as artificial general intelligence (AGI), that may have the most significant impacts on national and global security. Experts in both countries expressed concern about risks from AGI, risks from intelligence explosions, and risks from AI systems that escape human control. Both countries have also launched early efforts designed to promote international cooperation around safety standards and risk management practices. Notably, our findings only reflect information from publicly available sources. Nonetheless, our findings can inform policymakers and researchers about the state of AI discourse in the US and China. We hope such work can contribute to policy discussions around advanced AI, its global security threats, and potential international dialogues or agreements to mitigate such threats.