Evaluating Frontier Models for Dangerous Capabilities
This work addresses the need for rigorous evaluation of AI risks for safety researchers and policymakers, though it is incremental as it builds on prior work.
The paper tackled the problem of assessing risks from new AI systems by introducing a program of dangerous capability evaluations, piloting them on Gemini 1.0 models across four areas, and found no strong evidence of dangerous capabilities but flagged early warning signs.
To understand the risks posed by a new AI system, we must understand what it can and cannot do. Building on prior work, we introduce a programme of new "dangerous capability" evaluations and pilot them on Gemini 1.0 models. Our evaluations cover four areas: (1) persuasion and deception; (2) cyber-security; (3) self-proliferation; and (4) self-reasoning. We do not find evidence of strong dangerous capabilities in the models we evaluated, but we flag early warning signs. Our goal is to help advance a rigorous science of dangerous capability evaluation, in preparation for future models.