CVAIMar 17, 2023

Exploiting Semantic Attributes for Transductive Zero-Shot Learning

arXiv:2303.09849v11 citationsh-index: 53
Originality Incremental advance
AI Analysis

This addresses the bias towards seen classes in zero-shot learning, offering an incremental improvement for computer vision tasks.

The paper tackles the problem of generating high-fidelity features for unseen classes in transductive zero-shot learning by incorporating semantic attributes from unlabeled data, achieving state-of-the-art results on five benchmarks.

Zero-shot learning (ZSL) aims to recognize unseen classes by generalizing the relation between visual features and semantic attributes learned from the seen classes. A recent paradigm called transductive zero-shot learning further leverages unlabeled unseen data during training and has obtained impressive results. These methods always synthesize unseen features from attributes through a generative adversarial network to mitigate the bias towards seen classes. However, they neglect the semantic information in the unlabeled unseen data and thus fail to generate high-fidelity attribute-consistent unseen features. To address this issue, we present a novel transductive ZSL method that produces semantic attributes of the unseen data and imposes them on the generative process. In particular, we first train an attribute decoder that learns the mapping from visual features to semantic attributes. Then, from the attribute decoder, we obtain pseudo-attributes of unlabeled data and integrate them into the generative model, which helps capture the detailed differences within unseen classes so as to synthesize more discriminative features. Experiments on five standard benchmarks show that our method yields state-of-the-art results for zero-shot learning.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes