CVJun 16, 2020

Dual-Resolution Correspondence Networks

arXiv:2006.08844v224.7195 citationsHas Code
Originality Highly original
AI Analysis

It addresses the problem of accurate image matching for computer vision applications, with incremental improvements in efficiency and performance.

The paper tackles dense pixel-wise correspondence between images by introducing DualRC-Net, a coarse-to-fine method that improves matching reliability and accuracy, achieving state-of-the-art results on benchmarks like HPatches, InLoc, and Aachen Day-Night.

We tackle the problem of establishing dense pixel-wise correspondences between a pair of images. In this work, we introduce Dual-Resolution Correspondence Networks (DualRC-Net), to obtain pixel-wise correspondences in a coarse-to-fine manner. DualRC-Net extracts both coarse- and fine- resolution feature maps. The coarse maps are used to produce a full but coarse 4D correlation tensor, which is then refined by a learnable neighbourhood consensus module. The fine-resolution feature maps are used to obtain the final dense correspondences guided by the refined coarse 4D correlation tensor. The selected coarse-resolution matching scores allow the fine-resolution features to focus only on a limited number of possible matches with high confidence. In this way, DualRC-Net dramatically increases matching reliability and localisation accuracy, while avoiding to apply the expensive 4D convolution kernels on fine-resolution feature maps. We comprehensively evaluate our method on large-scale public benchmarks including HPatches, InLoc, and Aachen Day-Night. It achieves the state-of-the-art results on all of them.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes