CVIVJun 20, 2023

HIDFlowNet: A Flow-Based Deep Network for Hyperspectral Image Denoising

arXiv:2306.17797v23 citationsh-index: 28
Originality Incremental advance
AI Analysis

This work addresses the over-smoothing issue in hyperspectral image denoising for remote sensing or imaging applications, offering a novel approach but with incremental improvements in a specific domain.

The paper tackles the ill-posed problem of hyperspectral image denoising by proposing HIDFlowNet, a flow-based network that learns the conditional distribution of clean images from noisy ones, enabling diverse restorations and addressing over-smoothing, achieving better or comparable results on simulated and real datasets.

Hyperspectral image (HSI) denoising is essentially ill-posed since a noisy HSI can be degraded from multiple clean HSIs. However, existing deep learning (DL)-based approaches only restore one clean HSI from the given noisy HSI with a deterministic mapping, thus ignoring the ill-posed issue and always resulting in an over-smoothing problem. Additionally, these DL-based methods often neglect that noise is part of the high-frequency component and their network architectures fail to decouple the learning of low-frequency and high-frequency. To alleviate these issues, this paper proposes a flow-based HSI denoising network (HIDFlowNet) to directly learn the conditional distribution of the clean HSI given the noisy HSI and thus diverse clean HSIs can be sampled from the conditional distribution. Overall, our HIDFlowNet is induced from the generative flow model and is comprised of an invertible decoder and a conditional encoder, which can explicitly decouple the learning of low-frequency and high-frequency information of HSI. Specifically, the invertible decoder is built by staking a succession of invertible conditional blocks (ICBs) to capture the local high-frequency details. The conditional encoder utilizes down-sampling operations to obtain low-resolution images and uses transformers to capture correlations over a long distance so that global low-frequency information can be effectively extracted. Extensive experiments on simulated and real HSI datasets verify that our proposed HIDFlowNet can obtain better or comparable results compared with other state-of-the-art methods.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes