CVJul 16, 2024

Cycle Contrastive Adversarial Learning for Unsupervised image Deraining

arXiv:2407.11750v12 citationsh-index: 5
Originality Incremental advance
AI Analysis

This work addresses the challenge of effective rain removal in images without paired data, which is incremental by enhancing existing unsupervised methods with contrastive learning techniques.

The paper tackles the problem of generating high-quality, rain-free images in unsupervised single image deraining by proposing CCLGAN, which combines cycle contrastive learning and location contrastive learning to improve semantic representation and content preservation, resulting in superior performance as demonstrated in experiments.

To tackle the difficulties in fitting paired real-world data for single image deraining (SID), recent unsupervised methods have achieved notable success. However, these methods often struggle to generate high-quality, rain-free images due to a lack of attention to semantic representation and image content, resulting in ineffective separation of content from the rain layer. In this paper, we propose a novel cycle contrastive generative adversarial network for unsupervised SID, called CCLGAN. This framework combines cycle contrastive learning (CCL) and location contrastive learning (LCL). CCL improves image reconstruction and rain-layer removal by bringing similar features closer and pushing dissimilar features apart in both semantic and discriminative spaces. At the same time, LCL preserves content information by constraining mutual information at the same location across different exemplars. CCLGAN shows superior performance, as extensive experiments demonstrate the benefits of CCLGAN and the effectiveness of its components.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes