Uncertainty-Aware Multi-View Representation Learning
This addresses the problem of handling dynamic noise in multi-view data for unsupervised learning, offering a domain-specific improvement over traditional fixed-weight methods.
The paper tackles the challenge of integrating noisy multi-view data in unsupervised learning by proposing Dynamic Uncertainty-Aware Networks (DUA-Nets), which weigh views per sample based on estimated uncertainty to improve representation quality, achieving superior performance and robustness in experiments.
Learning from different data views by exploring the underlying complementary information among them can endow the representation with stronger expressive ability. However, high-dimensional features tend to contain noise, and furthermore, the quality of data usually varies for different samples (even for different views), i.e., one view may be informative for one sample but not the case for another. Therefore, it is quite challenging to integrate multi-view noisy data under unsupervised setting. Traditional multi-view methods either simply treat each view with equal importance or tune the weights of different views to fixed values, which are insufficient to capture the dynamic noise in multi-view data. In this work, we devise a novel unsupervised multi-view learning approach, termed as Dynamic Uncertainty-Aware Networks (DUA-Nets). Guided by the uncertainty of data estimated from the generation perspective, intrinsic information from multiple views is integrated to obtain noise-free representations. Under the help of uncertainty, DUA-Nets weigh each view of individual sample according to data quality so that the high-quality samples (or views) can be fully exploited while the effects from the noisy samples (or views) will be alleviated. Our model achieves superior performance in extensive experiments and shows the robustness to noisy data.