CVIRJul 10, 2024

Inter and Intra Prior Learning-based Hyperspectral Image Reconstruction Using Snapshot SWIR Metasurface

arXiv:2407.07503v32 citationsh-index: 10
Originality Incremental advance
AI Analysis

This work addresses the need for compact and fast hyperspectral imaging in SWIR applications, though it appears incremental in method.

The paper tackles the problem of reconstructing high-quality shortwave-infrared hyperspectral images from snapshot data using a metasurface filter system, achieving superior performance and high speed compared to existing methods.

Shortwave-infrared(SWIR) spectral information, ranging from 1 μm to 2.5μm, overcomes the limitations of traditional color cameras in acquiring scene information. However, conventional SWIR hyperspectral imaging systems face challenges due to their bulky setups and low acquisition speeds. This work introduces a snapshot SWIR hyperspectral imaging system based on a metasurface filter and a corresponding filter selection method to achieve the lowest correlation coefficient among these filters. This system offers the advantages of compact size and snapshot imaging. We propose a novel inter and intra prior learning unfolding framework to achieve high-quality SWIR hyperspectral image reconstruction, which bridges the gap between prior learning and cross-stage information interaction. Additionally, We design an adaptive feature transfer mechanism to adaptively transfer the contextual correlation of multi-scale encoder features to prevent detailed information loss in the decoder. Experiment results demonstrate that our method can reconstruct hyperspectral images with high speed and superior performance over existing methods.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes