LGAIMay 5, 2024

On the Tractability of SHAP Explanations under Markovian Distributions

arXiv:2405.02936v213 citationsh-index: 21ICML
AI Analysis

This provides a more realistic and efficient method for explaining ML models, advancing beyond incremental improvements by addressing a key bottleneck in explainable AI.

The paper tackles the computational complexity of SHAP score computation by relaxing the unrealistic feature independence assumption to a Markovian one, showing that for classes like Weighted automata, Disjoint DNFs, and Decision Trees, it can be performed in polynomial time.

Thanks to its solid theoretical foundation, the SHAP framework is arguably one the most widely utilized frameworks for local explainability of ML models. Despite its popularity, its exact computation is known to be very challenging, proven to be NP-Hard in various configurations. Recent works have unveiled positive complexity results regarding the computation of the SHAP score for specific model families, encompassing decision trees, random forests, and some classes of boolean circuits. Yet, all these positive results hinge on the assumption of feature independence, often simplistic in real-world scenarios. In this article, we investigate the computational complexity of the SHAP score by relaxing this assumption and introducing a Markovian perspective. We show that, under the Markovian assumption, computing the SHAP score for the class of Weighted automata, Disjoint DNFs and Decision Trees can be performed in polynomial time, offering a first positive complexity result for the problem of SHAP score computation that transcends the limitations of the feature independence assumption.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes