Transferable Optimization Network for Cross-Domain Image Reconstruction
This work provides an incremental improvement for medical image reconstruction, specifically for MRI, by addressing data scarcity.
The paper proposes a transfer learning framework for image reconstruction, addressing the challenge of limited training data. It utilizes a universal feature-extractor trained on large, heterogeneous datasets and a task-specific domain-adapter, achieving high-quality reconstruction for undersampled MR images despite data limitations.
We develop a novel transfer learning framework to tackle the challenge of limited training data in image reconstruction problems. The proposed framework consists of two training steps, both of which are formed as bi-level optimizations. In the first step, we train a powerful universal feature-extractor that is capable of learning important knowledge from large, heterogeneous data sets in various domains. In the second step, we train a task-specific domain-adapter for a new target domain or task with only a limited amount of data available for training. Then the composition of the adapter and the universal feature-extractor effectively explores feature which serve as an important component of image regularization for the new domains, and this leads to high-quality reconstruction despite the data limitation issue. We apply this framework to reconstruct under-sampled MR images with limited data by using a collection of diverse data samples from different domains, such as images of other anatomies, measurements of various sampling ratios, and even different image modalities, including natural images. Experimental results demonstrate a promising transfer learning capability of the proposed method.