CVAug 31, 2023

Fine-Grained Cross-View Geo-Localization Using a Correlation-Aware Homography Estimator

arXiv:2308.16906v177 citationsh-index: 12
Originality Incremental advance
AI Analysis

This addresses the problem of precise location mapping from ground images for applications like autonomous navigation, though it is incremental with specific improvements over existing methods.

The paper tackles fine-grained cross-view geo-localization by aligning ground and satellite images using a correlation-aware homography estimator, achieving sub-pixel resolution and meter-level GPS accuracy with a 30 FPS speed, reducing mean metric localization error by up to 34.4% on benchmarks.

In this paper, we introduce a novel approach to fine-grained cross-view geo-localization. Our method aligns a warped ground image with a corresponding GPS-tagged satellite image covering the same area using homography estimation. We first employ a differentiable spherical transform, adhering to geometric principles, to accurately align the perspective of the ground image with the satellite map. This transformation effectively places ground and aerial images in the same view and on the same plane, reducing the task to an image alignment problem. To address challenges such as occlusion, small overlapping range, and seasonal variations, we propose a robust correlation-aware homography estimator to align similar parts of the transformed ground image with the satellite image. Our method achieves sub-pixel resolution and meter-level GPS accuracy by mapping the center point of the transformed ground image to the satellite image using a homography matrix and determining the orientation of the ground camera using a point above the central axis. Operating at a speed of 30 FPS, our method outperforms state-of-the-art techniques, reducing the mean metric localization error by 21.3% and 32.4% in same-area and cross-area generalization tasks on the VIGOR benchmark, respectively, and by 34.4% on the KITTI benchmark in same-area evaluation.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes