Justifications for Democratizing AI Alignment and Their Prospects
It addresses the normative dimension of AI alignment for affected stakeholders, proposing a hybrid solution that is incremental in combining existing approaches.
This paper examines justifications for democratic approaches to the normative problem in AI alignment, where stakeholders determine constraints, analyzing instrumental and non-instrumental reasons and identifying challenges like preventing illegitimate coercion. It suggests that neither purely epistocratic nor democratic approaches suffice, pointing toward hybrid frameworks with expert judgment and participatory input.
The AI alignment problem comprises both technical and normative dimensions. While technical solutions focus on implementing normative constraints in AI systems, the normative problem concerns determining what these constraints should be. This paper examines justifications for democratic approaches to the normative problem -- where affected stakeholders determine AI alignment -- as opposed to epistocratic approaches that defer to normative experts. We analyze both instrumental justifications (democratic approaches produce better outcomes) and non-instrumental justifications (democratic approaches prevent illegitimate authority or coercion). We argue that normative and metanormative uncertainty create a justificatory gap that democratic approaches aim to fill through political rather than theoretical justification. However, we identify significant challenges for democratic approaches, particularly regarding the prevention of illegitimate coercion through AI alignment. Our analysis suggests that neither purely epistocratic nor purely democratic approaches may be sufficient on their own, pointing toward hybrid frameworks that combine expert judgment with participatory input alongside institutional safeguards against AI monopolization.