CVAIAug 7, 2023

Part-Aware Transformer for Generalizable Person Re-identification

arXiv:2308.03322v289 citationsh-index: 61Has Code
AI Analysis

This work addresses domain generalization for person re-identification, enabling models to perform better on unseen domains, which is incremental but offers strong specific gains.

The paper tackles domain generalization in person re-identification by proposing a Part-aware Transformer with Cross-ID Similarity Learning and Part-guided Self-Distillation to reduce overfitting to domain-specific biases, achieving state-of-the-art performance with improvements of 10.9% in Rank1 and 12.8% in mAP under the Market→Duke setting.

Domain generalization person re-identification (DG-ReID) aims to train a model on source domains and generalize well on unseen domains. Vision Transformer usually yields better generalization ability than common CNN networks under distribution shifts. However, Transformer-based ReID models inevitably over-fit to domain-specific biases due to the supervised learning strategy on the source domain. We observe that while the global images of different IDs should have different features, their similar local parts (e.g., black backpack) are not bounded by this constraint. Motivated by this, we propose a pure Transformer model (termed Part-aware Transformer) for DG-ReID by designing a proxy task, named Cross-ID Similarity Learning (CSL), to mine local visual information shared by different IDs. This proxy task allows the model to learn generic features because it only cares about the visual similarity of the parts regardless of the ID labels, thus alleviating the side effect of domain-specific biases. Based on the local similarity obtained in CSL, a Part-guided Self-Distillation (PSD) is proposed to further improve the generalization of global features. Our method achieves state-of-the-art performance under most DG ReID settings. Under the Market$\to$Duke setting, our method exceeds state-of-the-art by 10.9% and 12.8% in Rank1 and mAP, respectively. The code is available at https://github.com/liyuke65535/Part-Aware-Transformer.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes