Multi-Source Video Domain Adaptation with Temporal Attentive Moment Alignment
This addresses domain adaptation for videos from multiple sources, which is more practical but challenging than single-source scenarios, though it appears incremental as it builds on existing MSDA methods.
The paper tackles the Multi-Source Video Domain Adaptation (MSVDA) problem by proposing the Temporal Attentive Moment Alignment Network (TAMAN), which dynamically aligns spatial and temporal feature moments to improve feature transfer, achieving superior performance across multiple benchmarks.
Multi-Source Domain Adaptation (MSDA) is a more practical domain adaptation scenario in real-world scenarios. It relaxes the assumption in conventional Unsupervised Domain Adaptation (UDA) that source data are sampled from a single domain and match a uniform data distribution. MSDA is more difficult due to the existence of different domain shifts between distinct domain pairs. When considering videos, the negative transfer would be provoked by spatial-temporal features and can be formulated into a more challenging Multi-Source Video Domain Adaptation (MSVDA) problem. In this paper, we address the MSVDA problem by proposing a novel Temporal Attentive Moment Alignment Network (TAMAN) which aims for effective feature transfer by dynamically aligning both spatial and temporal feature moments. TAMAN further constructs robust global temporal features by attending to dominant domain-invariant local temporal features with high local classification confidence and low disparity between global and local feature discrepancies. To facilitate future research on the MSVDA problem, we introduce comprehensive benchmarks, covering extensive MSVDA scenarios. Empirical results demonstrate a superior performance of the proposed TAMAN across multiple MSVDA benchmarks.