CVNov 21, 2024

Night-to-Day Translation via Illumination Degradation Disentanglement

arXiv:2411.14504v11 citationsh-index: 19
Originality Incremental advance
AI Analysis

This work addresses the challenge of night-to-day image translation for computer vision applications, representing an incremental advance by introducing a novel degradation disentanglement approach.

The paper tackles the problem of translating nighttime images to daytime-like versions by addressing complex illumination degradations, proposing a method that disentangles degradation patterns and achieves significant improvements in visual quality on two public datasets.

Night-to-Day translation (Night2Day) aims to achieve day-like vision for nighttime scenes. However, processing night images with complex degradations remains a significant challenge under unpaired conditions. Previous methods that uniformly mitigate these degradations have proven inadequate in simultaneously restoring daytime domain information and preserving underlying semantics. In this paper, we propose \textbf{N2D3} (\textbf{N}ight-to-\textbf{D}ay via \textbf{D}egradation \textbf{D}isentanglement) to identify different degradation patterns in nighttime images. Specifically, our method comprises a degradation disentanglement module and a degradation-aware contrastive learning module. Firstly, we extract physical priors from a photometric model based on Kubelka-Munk theory. Then, guided by these physical priors, we design a disentanglement module to discriminate among different illumination degradation regions. Finally, we introduce the degradation-aware contrastive learning strategy to preserve semantic consistency across distinct degradation regions. Our method is evaluated on two public datasets, demonstrating a significant improvement in visual quality and considerable potential for benefiting downstream tasks.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes