CVFeb 14, 2024

Few-Shot Object Detection with Sparse Context Transformers

arXiv:2402.09315v13 citationsh-index: 39
Originality Incremental advance
AI Analysis

This work addresses the problem of localizing objects with minimal labeled data for computer vision applications, representing an incremental improvement over existing methods.

The paper tackles the challenge of few-shot object detection by introducing a sparse context transformer (SCT) that leverages source domain knowledge and learns sparse contexts from limited target data, achieving competitive performance on benchmarks.

Few-shot detection is a major task in pattern recognition which seeks to localize objects using models trained with few labeled data. One of the mainstream few-shot methods is transfer learning which consists in pretraining a detection model in a source domain prior to its fine-tuning in a target domain. However, it is challenging for fine-tuned models to effectively identify new classes in the target domain, particularly when the underlying labeled training data are scarce. In this paper, we devise a novel sparse context transformer (SCT) that effectively leverages object knowledge in the source domain, and automatically learns a sparse context from only few training images in the target domain. As a result, it combines different relevant clues in order to enhance the discrimination power of the learned detectors and reduce class confusion. We evaluate the proposed method on two challenging few-shot object detection benchmarks, and empirical results show that the proposed method obtains competitive performance compared to the related state-of-the-art.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes