CVAILGIVSPAug 16, 2022

Subtype-Aware Dynamic Unsupervised Domain Adaptation

CMUHarvard
arXiv:2208.07754v110 citationsh-index: 90
Originality Incremental advance
AI Analysis

This work addresses domain adaptation for applications with complex subtype structures, such as medical imaging, though it appears to be an incremental improvement over existing prototypical network approaches.

The paper tackles the problem of unsupervised domain adaptation by addressing fine-grained subtype structure within classes, proposing a subtype-aware alignment method that improves target domain performance without requiring subtype labels. Experimental results on medical and benchmark datasets show the approach outperforms state-of-the-art UDA methods.

Unsupervised domain adaptation (UDA) has been successfully applied to transfer knowledge from a labeled source domain to target domains without their labels. Recently introduced transferable prototypical networks (TPN) further addresses class-wise conditional alignment. In TPN, while the closeness of class centers between source and target domains is explicitly enforced in a latent space, the underlying fine-grained subtype structure and the cross-domain within-class compactness have not been fully investigated. To counter this, we propose a new approach to adaptively perform a fine-grained subtype-aware alignment to improve performance in the target domain without the subtype label in both domains. The insight of our approach is that the unlabeled subtypes in a class have the local proximity within a subtype, while exhibiting disparate characteristics, because of different conditional and label shifts. Specifically, we propose to simultaneously enforce subtype-wise compactness and class-wise separation, by utilizing intermediate pseudo-labels. In addition, we systematically investigate various scenarios with and without prior knowledge of subtype numbers, and propose to exploit the underlying subtype structure. Furthermore, a dynamic queue framework is developed to evolve the subtype cluster centroids steadily using an alternative processing scheme. Experimental results, carried out with multi-view congenital heart disease data and VisDA and DomainNet, show the effectiveness and validity of our subtype-aware UDA, compared with state-of-the-art UDA methods.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes