IG-Diff: Complex Night Scene Restoration with Illumination-Guided Diffusion Model
For computer vision researchers working on low-level vision, this work addresses the underexplored problem of restoring images with multiple simultaneous night-time degradations.
The paper tackles complex night scene restoration where multiple degradations (e.g., low light and weather) coexist. It introduces a new dataset and an illumination-guided diffusion model that outperforms existing methods, achieving better texture fidelity and restoration quality.
In nighttime circumstances, it is challenging for individuals and machines to perceive their surroundings. While prevailing image restoration methods adeptly handle singular forms of degradation, they falter when confronted with intricate nocturnal scenes, such as the concurrent presence of weather and low-light conditions. Compounding this challenge, the lack of paired data that encapsulates the coexistence of low-light situations and other forms of degradation hinders the development of a comprehensive end-to-end solution. In this work, we contribute complex nighttime scene datasets that simulate both illumination degradation and other forms of deterioration. To address the complexity of night degradation, we propose an integration of an illumination-guided module embedded in the diffusion model to guide the illumination restoration process. Our model can preserve texture fidelity while contending with the adversities posed by various degradation in low-light scenarios.