Manifold learning and optimization using tangent space proxies
This provides a more efficient method for manifold learning and optimization, which is incremental but useful for applications in machine learning and data analysis.
The authors developed a framework for approximating differential-geometric primitives on arbitrary manifolds using an atlas graph representation, achieving a runtime advantage for first-order optimization over the Grassmann manifold compared to state-of-the-art approaches and enabling downstream tasks like Riemannian support vector machines.
We present a framework for efficiently approximating differential-geometric primitives on arbitrary manifolds via construction of an atlas graph representation, which leverages the canonical characterization of a manifold as a finite collection, or atlas, of overlapping coordinate charts. We first show the utility of this framework in a setting where the manifold is expressed in closed form, specifically, a runtime advantage, compared with state-of-the-art approaches, for first-order optimization over the Grassmann manifold. Moreover, using point cloud data for which a complex manifold structure was previously established, i.e., high-contrast image patches, we show that an atlas graph with the correct geometry can be directly learned from the point cloud. Finally, we demonstrate that learning an atlas graph enables downstream key machine learning tasks. In particular, we implement a Riemannian generalization of support vector machines that uses the learned atlas graph to approximate complex differential-geometric primitives, including Riemannian logarithms and vector transports. These settings suggest the potential of this framework for even more complex settings, where ambient dimension and noise levels may be much higher.