MLLGOct 20, 2023

Optimal Transport for Measures with Noisy Tree Metric

arXiv:2310.13653v38 citationsh-index: 49
Originality Incremental advance
AI Analysis

This work addresses a practical issue in applying tree-Wasserstein distances to real-world data with noisy measurements, offering a computationally efficient solution for researchers in machine learning and data analysis.

The authors tackled the problem of computing optimal transport for probability measures on tree metric spaces when the tree structure is noisy, by proposing a robust OT formulation with uncertainty sets based on edge modifications. They showed that this robust OT has a closed-form expression, enabling fast computation, and demonstrated its effectiveness in document classification and topological data analysis tasks.

We study optimal transport (OT) problem for probability measures supported on a tree metric space. It is known that such OT problem (i.e., tree-Wasserstein (TW)) admits a closed-form expression, but depends fundamentally on the underlying tree structure over supports of input measures. In practice, the given tree structure may be, however, perturbed due to noisy or adversarial measurements. To mitigate this issue, we follow the max-min robust OT approach which considers the maximal possible distances between two input measures over an uncertainty set of tree metrics. In general, this approach is hard to compute, even for measures supported in one-dimensional space, due to its non-convexity and non-smoothness which hinders its practical applications, especially for large-scale settings. In this work, we propose novel uncertainty sets of tree metrics from the lens of edge deletion/addition which covers a diversity of tree structures in an elegant framework. Consequently, by building upon the proposed uncertainty sets, and leveraging the tree structure over supports, we show that the robust OT also admits a closed-form expression for a fast computation as its counterpart standard OT (i.e., TW). Furthermore, we demonstrate that the robust OT satisfies the metric property and is negative definite. We then exploit its negative definiteness to propose positive definite kernels and test them in several simulations on various real-world datasets on document classification and topological data analysis.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes