CVNov 19, 2024

CV-Cities: Advancing Cross-View Geo-Localization in Global Cities

arXiv:2411.12431v134 citationsh-index: 6Has CodeIEEE J Sel Top Appl Earth Obs Remote Sens
Originality Incremental advance
AI Analysis

It addresses geo-localization in GNSS-constrained scenarios, offering a novel dataset and improved method, but is incremental as it builds on existing CVGL approaches.

The paper tackles cross-view geo-localization by proposing a framework that integrates DINOv2 with a feature mixer and new sampling strategies, achieving high localization accuracy across multiple datasets, including a new global dataset CV-Cities with 223,736 image pairs.

Cross-view geo-localization (CVGL), which involves matching and retrieving satellite images to determine the geographic location of a ground image, is crucial in GNSS-constrained scenarios. However, this task faces significant challenges due to substantial viewpoint discrepancies, the complexity of localization scenarios, and the need for global localization. To address these issues, we propose a novel CVGL framework that integrates the vision foundational model DINOv2 with an advanced feature mixer. Our framework introduces the symmetric InfoNCE loss and incorporates near-neighbor sampling and dynamic similarity sampling strategies, significantly enhancing localization accuracy. Experimental results show that our framework surpasses existing methods across multiple public and self-built datasets. To further improve globalscale performance, we have developed CV-Cities, a novel dataset for global CVGL. CV-Cities includes 223,736 ground-satellite image pairs with geolocation data, spanning sixteen cities across six continents and covering a wide range of complex scenarios, providing a challenging benchmark for CVGL. The framework trained with CV-Cities demonstrates high localization accuracy in various test cities, highlighting its strong globalization and generalization capabilities. Our datasets and codes are available at https://github.com/GaoShuang98/CVCities.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes