All Graphs Lead to Rome: Learning Geometric and Cycle-Consistent Representations with Graph Convolutional Networks
This addresses the problem of geometric computer vision applications where ground truth correspondence is hard to obtain, though it is incremental as it builds on existing graph and consistency methods.
The paper tackles multi-image feature matching by formulating it as a graph embedding problem and using a Graph Convolutional Network trained with unsupervised cycle consistency, achieving competitive performance with optimization-based approaches.
Image feature matching is a fundamental part of many geometric computer vision applications, and using multiple images can improve performance. In this work, we formulate multi-image matching as a graph embedding problem then use a Graph Convolutional Network to learn an appropriate embedding function for aligning image features. We use cycle consistency to train our network in an unsupervised fashion, since ground truth correspondence is difficult or expensive to aquire. In addition, geometric consistency losses can be added at training time, even if the information is not available in the test set, unlike previous approaches that optimize cycle consistency directly. To the best of our knowledge, no other works have used learning for multi-image feature matching. Our experiments show that our method is competitive with other optimization based approaches.