Multibranch Generative Models for Multichannel Imaging with an Application to PET/CT Synergistic Reconstruction
This addresses image reconstruction challenges in medical imaging, particularly for low-dose PET/CT, but is incremental as it builds on existing VAEs and synergistic methods.
The paper tackles synergistic reconstruction of medical images from PET/CT data using multibranch generative models, achieving improved image quality for low-dose imaging as demonstrated on MNIST and PET/CT datasets.
This paper presents a novel approach for learned synergistic reconstruction of medical images using multibranch generative models. Leveraging variational autoencoders (VAEs), our model learns from pairs of images simultaneously, enabling effective denoising and reconstruction. Synergistic image reconstruction is achieved by incorporating the trained models in a regularizer that evaluates the distance between the images and the model. We demonstrate the efficacy of our approach on both Modified National Institute of Standards and Technology (MNIST) and positron emission tomography (PET)/computed tomography (CT) datasets, showcasing improved image quality for low-dose imaging. Despite challenges such as patch decomposition and model limitations, our results underscore the potential of generative models for enhancing medical imaging reconstruction.