LGDSMLFeb 20, 2023

Replicable Clustering

arXiv:2302.10359v321 citationsh-index: 62
Originality Incremental advance
AI Analysis

This addresses the need for reliable and reproducible clustering in statistical settings, offering incremental improvements by applying existing combinatorial approximation methods to ensure replicability.

The paper tackles the problem of designing replicable clustering algorithms that produce consistent partitions across multiple runs on different inputs from the same distribution, achieving an O(1)-approximation for statistical Euclidean k-medians and k-means with polynomial sample complexity, and an O(1)-approximation with additive error for k-centers with exponential sample complexity.

We design replicable algorithms in the context of statistical clustering under the recently introduced notion of replicability from Impagliazzo et al. [2022]. According to this definition, a clustering algorithm is replicable if, with high probability, its output induces the exact same partition of the sample space after two executions on different inputs drawn from the same distribution, when its internal randomness is shared across the executions. We propose such algorithms for the statistical $k$-medians, statistical $k$-means, and statistical $k$-centers problems by utilizing approximation routines for their combinatorial counterparts in a black-box manner. In particular, we demonstrate a replicable $O(1)$-approximation algorithm for statistical Euclidean $k$-medians ($k$-means) with $\operatorname{poly}(d)$ sample complexity. We also describe an $O(1)$-approximation algorithm with an additional $O(1)$-additive error for statistical Euclidean $k$-centers, albeit with $\exp(d)$ sample complexity. In addition, we provide experiments on synthetic distributions in 2D using the $k$-means++ implementation from sklearn as a black-box that validate our theoretical results.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes