MLLGDec 3, 2018

Interpretable Clustering via Optimal Trees

arXiv:1812.00539v131 citations
Originality Incremental advance
AI Analysis

This addresses the need for interpretable clustering in domains like healthcare where explanations are required for trust and liability, though it appears incremental as an extension of Optimal Trees to clustering.

The paper tackles the problem of uninterpretable clustering algorithms by developing a new unsupervised learning method using Mixed Integer Optimization to create interpretable tree-based clustering models. The algorithm achieves comparable or superior performance to K-Means on synthetic and real-world datasets while providing significantly higher interpretability.

State-of-the-art clustering algorithms use heuristics to partition the feature space and provide little insight into the rationale for cluster membership, limiting their interpretability. In healthcare applications, the latter poses a barrier to the adoption of these methods since medical researchers are required to provide detailed explanations of their decisions in order to gain patient trust and limit liability. We present a new unsupervised learning algorithm that leverages Mixed Integer Optimization techniques to generate interpretable tree-based clustering models. Utilizing the flexible framework of Optimal Trees, our method approximates the globally optimal solution leading to high quality partitions of the feature space. Our algorithm, can incorporate various internal validation metrics, naturally determines the optimal number of clusters, and is able to account for mixed numeric and categorical data. It achieves comparable or superior performance on both synthetic and real world datasets when compared to K-Means while offering significantly higher interpretability.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes