CVLGJan 18, 2021

Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Bias

arXiv:2101.07296v2111 citations
Originality Incremental advance
AI Analysis

This work addresses low-shot learning for computer vision, offering an incremental improvement by integrating shape bias into existing methods.

The paper tackles the problem of low-shot learning by incorporating explicit 3D shape reasoning to improve generalization, resulting in performance gains on multiple datasets.

It is widely accepted that reasoning about object shape is important for object recognition. However, the most powerful object recognition methods today do not explicitly make use of object shape during learning. In this work, motivated by recent developments in low-shot learning, findings in developmental psychology, and the increased use of synthetic data in computer vision research, we investigate how reasoning about 3D shape can be used to improve low-shot learning methods' generalization performance. We propose a new way to improve existing low-shot learning approaches by learning a discriminative embedding space using 3D object shape, and using this embedding by learning how to map images into it. Our new approach improves the performance of image-only low-shot learning approaches on multiple datasets. We also introduce Toys4K, a 3D object dataset with the largest number of object categories currently available, which supports low-shot learning.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes