Brain Tumor Synthetic Segmentation in 3D Multimodal MRI Scans
This work addresses brain tumor segmentation for medical diagnosis, offering an incremental improvement by substituting synthetic images for real modalities.
The paper tackled the challenging automatic segmentation of brain tumor subregions in 3D multimodal MRI scans by using a GAN to synthesize high-contrast images, which improved segmentation and reduced the need for real channels.
The magnetic resonance (MR) analysis of brain tumors is widely used for diagnosis and examination of tumor subregions. The overlapping area among the intensity distribution of healthy, enhancing, non-enhancing, and edema regions makes the automatic segmentation a challenging task. Here, we show that a convolutional neural network trained on high-contrast images can transform the intensity distribution of brain lesions in its internal subregions. Specifically, a generative adversarial network (GAN) is extended to synthesize high-contrast images. A comparison of these synthetic images and real images of brain tumor tissue in MR scans showed significant segmentation improvement and decreased the number of real channels for segmentation. The synthetic images are used as a substitute for real channels and can bypass real modalities in the multimodal brain tumor segmentation framework. Segmentation results on BraTS 2019 dataset demonstrate that our proposed approach can efficiently segment the tumor areas. In the end, we predict patient survival time based on volumetric features of the tumor subregions as well as the age of each case through several regression models.