Multi-Scale and Multi-Layer Contrastive Learning for Domain Generalization
It addresses the failure of image classifiers to generalize to unseen visual contexts, which is crucial for real-world applications, but appears incremental as it builds on existing contrastive learning and domain generalization methods.
The paper tackles the domain generalization problem in image classification by improving the generalization ability of deep convolutional neural networks through multi-layer and multi-scaled representations, achieving state-of-the-art results on datasets like PACS, VLCS, Office-Home, and NICO.
During the past decade, deep neural networks have led to fast-paced progress and significant achievements in computer vision problems, for both academia and industry. Yet despite their success, state-of-the-art image classification approaches fail to generalize well in previously unseen visual contexts, as required by many real-world applications. In this paper, we focus on this domain generalization (DG) problem and argue that the generalization ability of deep convolutional neural networks can be improved by taking advantage of multi-layer and multi-scaled representations of the network. We introduce a framework that aims at improving domain generalization of image classifiers by combining both low-level and high-level features at multiple scales, enabling the network to implicitly disentangle representations in its latent space and learn domain-invariant attributes of the depicted objects. Additionally, to further facilitate robust representation learning, we propose a novel objective function, inspired by contrastive learning, which aims at constraining the extracted representations to remain invariant under distribution shifts. We demonstrate the effectiveness of our method by evaluating on the domain generalization datasets of PACS, VLCS, Office-Home and NICO. Through extensive experimentation, we show that our model is able to surpass the performance of previous DG methods and consistently produce competitive and state-of-the-art results in all datasets