LGNov 9, 2023

Accelerated Shapley Value Approximation for Data Evaluation

arXiv:2311.05346v14 citationsh-index: 9
Originality Incremental advance
AI Analysis

This addresses the bottleneck of slow Shapley value approximation for data evaluation in machine learning applications like data filtering and sharing, though it is incremental.

The paper tackles the computational expense of approximating Shapley values for data valuation by proposing a method that uses only small subsets of data, achieving up to 9.9x speedup while preserving approximate value and rank.

Data valuation has found various applications in machine learning, such as data filtering, efficient learning and incentives for data sharing. The most popular current approach to data valuation is the Shapley value. While popular for its various applications, Shapley value is computationally expensive even to approximate, as it requires repeated iterations of training models on different subsets of data. In this paper we show that the Shapley value of data points can be approximated more efficiently by leveraging the structural properties of machine learning problems. We derive convergence guarantees on the accuracy of the approximate Shapley value for different learning settings including Stochastic Gradient Descent with convex and non-convex loss functions. Our analysis suggests that in fact models trained on small subsets are more important in the context of data valuation. Based on this idea, we describe $δ$-Shapley -- a strategy of only using small subsets for the approximation. Experiments show that this approach preserves approximate value and rank of data, while achieving speedup of up to 9.9x. In pre-trained networks the approach is found to bring more efficiency in terms of accurate evaluation using small subsets.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes