AIJan 11, 2023

Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretability

Stanford
arXiv:2301.04709v4151 citationsh-index: 24
Originality Incremental advance
AI Analysis

This provides a foundational framework for researchers in AI interpretability, though it is incremental in building on existing causal theory.

The paper tackles the lack of a theoretical foundation for mechanistic interpretability by developing causal abstraction theory, which generalizes mechanism transformations and formalizes key concepts to unify various interpretability methods.

Causal abstraction provides a theoretical foundation for mechanistic interpretability, the field concerned with providing intelligible algorithms that are faithful simplifications of the known, but opaque low-level details of black box AI models. Our contributions are (1) generalizing the theory of causal abstraction from mechanism replacement (i.e., hard and soft interventions) to arbitrary mechanism transformation (i.e., functionals from old mechanisms to new mechanisms), (2) providing a flexible, yet precise formalization for the core concepts of polysemantic neurons, the linear representation hypothesis, modular features, and graded faithfulness, and (3) unifying a variety of mechanistic interpretability methods in the common language of causal abstraction, namely, activation and path patching, causal mediation analysis, causal scrubbing, causal tracing, circuit analysis, concept erasure, sparse autoencoders, differential binary masking, distributed alignment search, and steering.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes