CVAug 27, 2020

Learning Condition Invariant Features for Retrieval-Based Localization from 1M Images

arXiv:2008.12165v2
AI Analysis

This work addresses retrieval-based localization for robotics or autonomous systems by improving feature invariance to dynamic and environmental changes, though it is incremental as it builds on existing loss functions and mining techniques.

The paper tackled the problem of learning condition-invariant features for retrieval-based localization by evaluating methods on large datasets, including Oxford RobotCar with over 1 million images, and developed a novel method that improved localization accuracy by 24.4% on night conditions compared to triplet loss.

Image features for retrieval-based localization must be invariant to dynamic objects (e.g. cars) as well as seasonal and daytime changes. Such invariances are, up to some extent, learnable with existing methods using triplet-like losses, given a large number of diverse training images. However, due to the high algorithmic training complexity, there exists insufficient comparison between different loss functions on large datasets. In this paper, we train and evaluate several localization methods on three different benchmark datasets, including Oxford RobotCar with over one million images. This large scale evaluation yields valuable insights into the generalizability and performance of retrieval-based localization. Based on our findings, we develop a novel method for learning more accurate and better generalizing localization features. It consists of two main contributions: (i) a feature volume-based loss function, and (ii) hard positive and pairwise negative mining. On the challenging Oxford RobotCar night condition, our method outperforms the well-known triplet loss by 24.4% in localization accuracy within 5m.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes