Continual Learning-Based Unified Model for Unpaired Image Restoration Tasks
This addresses the need for a single model to handle various weather conditions in applications like autonomous driving, though it is incremental as it builds on existing continual learning and unpaired restoration techniques.
The paper tackles the problem of restoring images corrupted by multiple adverse weather conditions like fog, snow, and rain, proposing a continual learning-based unified model that achieves significant improvements in PSNR, SSIM, and perceptual quality over state-of-the-art methods on benchmark datasets.
Restoration of images contaminated by different adverse weather conditions such as fog, snow, and rain is a challenging task due to the varying nature of the weather conditions. Most of the existing methods focus on any one particular weather conditions. However, for applications such as autonomous driving, a unified model is necessary to perform restoration of corrupted images due to different weather conditions. We propose a continual learning approach to propose a unified framework for image restoration. The proposed framework integrates three key innovations: (1) Selective Kernel Fusion layers that dynamically combine global and local features for robust adaptive feature selection; (2) Elastic Weight Consolidation (EWC) to enable continual learning and mitigate catastrophic forgetting across multiple restoration tasks; and (3) a novel Cycle-Contrastive Loss that enhances feature discrimination while preserving semantic consistency during domain translation. Further, we propose an unpaired image restoration approach to reduce the dependance of the proposed approach on the training data. Extensive experiments on standard benchmark datasets for dehazing, desnowing and deraining tasks demonstrate significant improvements in PSNR, SSIM, and perceptual quality over the state-of-the-art.