Noisier2Inverse: Self-Supervised Learning for Image Reconstruction with Correlated Noise
This addresses a domain-specific challenge in imaging applications where noise correlations complicate reconstruction, offering an incremental improvement over existing self-supervised methods.
The paper tackles the problem of image reconstruction in inverse problems with correlated noise, such as in computed tomography and microscopy, by proposing Noisier2Inverse, a self-supervised deep learning method that eliminates the need for ground truth samples and outperforms previous approaches.
We propose Noisier2Inverse, a correction-free self-supervised deep learning approach for general inverse problems. The proposed method learns a reconstruction function without the need for ground truth samples and is applicable in cases where measurement noise is statistically correlated. This includes computed tomography, where detector imperfections or photon scattering create correlated noise patterns, as well as microscopy and seismic imaging, where physical interactions during measurement introduce dependencies in the noise structure. Similar to Noisier2Noise, a key step in our approach is the generation of noisier data from which the reconstruction network learns. However, unlike Noisier2Noise, the proposed loss function operates in measurement space and is trained to recover an extrapolated image instead of the original noisy one. This eliminates the need for an extrapolation step during inference, which would otherwise suffer from ill-posedness. We numerically demonstrate that our method clearly outperforms previous self-supervised approaches that account for correlated noise.