MLDSLGDec 17, 2019

Balancing the Tradeoff Between Clustering Value and Interpretability

arXiv:1912.07820v346 citations
Originality Incremental advance
AI Analysis

This addresses the need for interpretable clusters in automated decision-support systems, though it is incremental as it builds on existing clustering methods by adding interpretability constraints.

The paper tackles the problem of generating interpretable graph clusters by optimizing interpretability alongside clustering objectives, proposing a β-interpretable clustering algorithm that ensures at least a β fraction of nodes in each cluster share the same feature value, and empirically demonstrates benefits on four real-world datasets.

Graph clustering groups entities -- the vertices of a graph -- based on their similarity, typically using a complex distance function over a large number of features. Successful integration of clustering approaches in automated decision-support systems hinges on the interpretability of the resulting clusters. This paper addresses the problem of generating interpretable clusters, given features of interest that signify interpretability to an end-user, by optimizing interpretability in addition to common clustering objectives. We propose a $β$-interpretable clustering algorithm that ensures that at least $β$ fraction of nodes in each cluster share the same feature value. The tunable parameter $β$ is user-specified. We also present a more efficient algorithm for scenarios with $β\!=\!1$ and analyze the theoretical guarantees of the two algorithms. Finally, we empirically demonstrate the benefits of our approaches in generating interpretable clusters using four real-world datasets. The interpretability of the clusters is complemented by generating simple explanations denoting the feature values of the nodes in the clusters, using frequent pattern mining.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes