CVNov 10, 2022

Learning Cross-view Geo-localization Embeddings via Dynamic Weighted Decorrelation Regularization

arXiv:2211.05296v161 citationsh-index: 39
Originality Incremental advance
AI Analysis

This work addresses geo-localization for drone and satellite image matching, offering an incremental improvement over existing methods.

The paper tackles cross-view geo-localization by addressing embedding redundancy, introducing Dynamic Weighted Decorrelation Regularization (DWDR) to learn independent channels, achieving competitive results on benchmarks like University-1652 and surpassing baselines with short features of 64 dimensions.

Cross-view geo-localization aims to spot images of the same location shot from two platforms, e.g., the drone platform and the satellite platform. Existing methods usually focus on optimizing the distance between one embedding with others in the feature space, while neglecting the redundancy of the embedding itself. In this paper, we argue that the low redundancy is also of importance, which motivates the model to mine more diverse patterns. To verify this point, we introduce a simple yet effective regularization, i.e., Dynamic Weighted Decorrelation Regularization (DWDR), to explicitly encourage networks to learn independent embedding channels. As the name implies, DWDR regresses the embedding correlation coefficient matrix to a sparse matrix, i.e., the identity matrix, with dynamic weights. The dynamic weights are applied to focus on still correlated channels during training. Besides, we propose a cross-view symmetric sampling strategy, which keeps the example balance between different platforms. Albeit simple, the proposed method has achieved competitive results on three large-scale benchmarks, i.e., University-1652, CVUSA and CVACT. Moreover, under the harsh circumstance, e.g., the extremely short feature of 64 dimensions, the proposed method surpasses the baseline model by a clear margin.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes