IVCVSPMar 4, 2022

Convolutional Analysis Operator Learning by End-To-End Training of Iterative Neural Networks

arXiv:2203.02166v11 citationsh-index: 60
AI Analysis

This work addresses the challenge of integrating physical models into sparsifying transform learning for medical imaging, offering an incremental improvement over existing methods.

The paper tackled the problem of learning sparsifying transforms for image reconstruction by proposing end-to-end training of iterative neural networks that incorporate the physical model, and demonstrated improved filter suitability for cardiac cine MRI reconstruction compared to decoupled pre-training.

The concept of sparsity has been extensively applied for regularization in image reconstruction. Typically, sparsifying transforms are either pre-trained on ground-truth images or adaptively trained during the reconstruction. Thereby, learning algorithms are designed to minimize some target function which encodes the desired properties of the transform. However, this procedure ignores the subsequently employed reconstruction algorithm as well as the physical model which is responsible for the image formation process. Iterative neural networks - which contain the physical model - can overcome these issues. In this work, we demonstrate how convolutional sparsifying filters can be efficiently learned by end-to-end training of iterative neural networks. We evaluated our approach on a non-Cartesian 2D cardiac cine MRI example and show that the obtained filters are better suitable for the corresponding reconstruction algorithm than the ones obtained by decoupled pre-training.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes