Computational Compliance for AI Regulation: Blueprint for a New Research Domain
This work defines a new research domain for computational compliance with AI regulation, which is incremental as it builds on existing regulatory needs without presenting a specific method.
The paper addresses the challenge of AI systems complying with regulations at scale by proposing computational compliance algorithms, and it introduces design goals and a benchmark dataset to evaluate such algorithms.
The era of AI regulation (AIR) is upon us. But AI systems, we argue, will not be able to comply with these regulations at the necessary speed and scale by continuing to rely on traditional, analogue methods of compliance. Instead, we posit that compliance with these regulations will only realistically be achieved computationally: that is, with algorithms that run across the life cycle of an AI system, automatically steering it toward AIR compliance in the face of dynamic conditions. Yet despite their (we would argue) inevitability, the research community has yet to specify exactly how these algorithms for computational AIR compliance should behave - or how we should benchmark their performance. To fill these gaps, we specify a set of design goals for such algorithms. In addition, we specify a benchmark dataset that can be used to quantitatively measure whether individual algorithms satisfy these design goals. By delivering this blueprint, we hope to give shape to an important but uncrystallized new domain of research - and, in doing so, incite necessary investment in it.