OCDSLGNAAug 7, 2020

Polynomial-time algorithms for Multimarginal Optimal Transport problems with structure

arXiv:2008.03006v435 citations
AI Analysis

This work addresses a critical bottleneck in applying MOT to machine learning, statistics, and sciences by making it computationally feasible for many real-world problems, representing a foundational advance rather than an incremental improvement.

This paper tackles the computational inefficiency of Multimarginal Optimal Transport (MOT), which typically requires exponential time, by developing a unified algorithmic framework that identifies structural conditions enabling polynomial-time solutions. It shows that the Sinkhorn algorithm requires stricter structure than others, provides new polynomial-time algorithms for three general cost structures, and offers the first such algorithms for exact/sparse solutions in some cases and approximate ones in others.

Multimarginal Optimal Transport (MOT) has attracted significant interest due to applications in machine learning, statistics, and the sciences. However, in most applications, the success of MOT is severely limited by a lack of efficient algorithms. Indeed, MOT in general requires exponential time in the number of marginals k and their support sizes n. This paper develops a general theory about what "structure" makes MOT solvable in poly(n,k) time. We develop a unified algorithmic framework for solving MOT in poly(n,k) time by characterizing the "structure" that different algorithms require in terms of simple variants of the dual feasibility oracle. This framework has several benefits. First, it enables us to show that the Sinkhorn algorithm, which is currently the most popular MOT algorithm, requires strictly more structure than other algorithms do to solve MOT in poly(n,k) time. Second, our framework makes it much simpler to develop poly(n,k) time algorithms for a given MOT problem. In particular, it is necessary and sufficient to (approximately) solve the dual feasibility oracle -- which is much more amenable to standard algorithmic techniques. We illustrate this ease-of-use by developing poly(n,k) time algorithms for three general classes of MOT cost structures: (1) graphical structure; (2) set-optimization structure; and (3) low-rank plus sparse structure. For structure (1), we recover the known result that Sinkhorn has poly(n,k) runtime; moreover, we provide the first poly(n,k) time algorithms for computing solutions that are exact and sparse. For structures (2)-(3), we give the first poly(n,k) time algorithms, even for approximate computation. Together, these three structures encompass many -- if not most -- current applications of MOT.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes