MLDSLGOCDec 12, 2018

Massively scalable Sinkhorn distances via the Nyström method

arXiv:1812.05189v3121 citations
Originality Highly original
AI Analysis

This addresses a scalability bottleneck for researchers and practitioners using Sinkhorn distances in machine learning and statistical inference, offering a practical solution for massive data sets.

The paper tackled the computational inefficiency of Sinkhorn distances, which scale quadratically with data size, by combining the Nyström method and Sinkhorn scaling to achieve an accurate approximation with significantly lower time and memory requirements, enabling computation on data sets hundreds of times larger than previous methods.

The Sinkhorn "distance", a variant of the Wasserstein distance with entropic regularization, is an increasingly popular tool in machine learning and statistical inference. However, the time and memory requirements of standard algorithms for computing this distance grow quadratically with the size of the data, making them prohibitively expensive on massive data sets. In this work, we show that this challenge is surprisingly easy to circumvent: combining two simple techniques---the Nyström method and Sinkhorn scaling---provably yields an accurate approximation of the Sinkhorn distance with significantly lower time and memory requirements than other approaches. We prove our results via new, explicit analyses of the Nyström method and of the stability properties of Sinkhorn scaling. We validate our claims experimentally by showing that our approach easily computes Sinkhorn distances on data sets hundreds of times larger than can be handled by other techniques.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes