CVAug 2, 2017

Associative Domain Adaptation

arXiv:1708.00938v1253 citations
Originality Incremental advance
AI Analysis

This addresses the problem of inferring class labels in unlabeled target domains for machine learning practitioners, offering an incremental improvement over existing methods like maximum mean discrepancy.

The paper tackles domain adaptation by proposing associative domain adaptation, a technique that reinforces associations between source and target data in embedding space to produce domain-invariant embeddings, achieving state-of-the-art results on various benchmarks with a generic CNN architecture.

We propose associative domain adaptation, a novel technique for end-to-end domain adaptation with neural networks, the task of inferring class labels for an unlabeled target domain based on the statistical properties of a labeled source domain. Our training scheme follows the paradigm that in order to effectively derive class labels for the target domain, a network should produce statistically domain invariant embeddings, while minimizing the classification error on the labeled source domain. We accomplish this by reinforcing associations between source and target data directly in embedding space. Our method can easily be added to any existing classification network with no structural and almost no computational overhead. We demonstrate the effectiveness of our approach on various benchmarks and achieve state-of-the-art results across the board with a generic convolutional neural network architecture not specifically tuned to the respective tasks. Finally, we show that the proposed association loss produces embeddings that are more effective for domain adaptation compared to methods employing maximum mean discrepancy as a similarity measure in embedding space.

Code Implementations2 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes