AIReg-Bench: Benchmarking Language Models That Assess AI Regulation Compliance
This provides a benchmark for researchers and practitioners interested in using LLMs to automate compliance checks with AI regulations, though it is incremental as it focuses on creating a dataset rather than a new method.
The paper tackles the lack of benchmarks for evaluating language models in assessing AI regulation compliance by introducing AIReg-Bench, a dataset with 120 annotated samples based on the EU AI Act, and finds that frontier LLMs can reproduce expert labels, establishing a baseline for future comparisons.
As governments move to regulate AI, there is growing interest in using Large Language Models (LLMs) to assess whether or not an AI system complies with a given AI Regulation (AIR). However, there is presently no way to benchmark the performance of LLMs at this task. To fill this void, we introduce AIReg-Bench: the first benchmark dataset designed to test how well LLMs can assess compliance with the EU AI Act (AIA). We created this dataset through a two-step process: (1) by prompting an LLM with carefully structured instructions, we generated 120 technical documentation excerpts (samples), each depicting a fictional, albeit plausible, AI system - of the kind an AI provider might produce to demonstrate their compliance with AIR; (2) legal experts then reviewed and annotated each sample to indicate whether, and in what way, the AI system described therein violates specific Articles of the AIA. The resulting dataset, together with our evaluation of whether frontier LLMs can reproduce the experts' compliance labels, provides a starting point to understand the opportunities and limitations of LLM-based AIR compliance assessment tools and establishes a benchmark against which subsequent LLMs can be compared. The dataset and evaluation code are available at https://github.com/camlsys/aireg-bench.