Unsupervised Reverse Domain Adaptation for Synthetic Medical Images via Adversarial Training
This addresses the challenge of data scarcity in medical imaging for tasks like depth estimation, though it is incremental as it adapts existing adversarial methods to a reverse flow.
The paper tackles the problem of limited annotated medical images by proposing a reverse domain adaptation framework that makes real medical images resemble synthetic ones via adversarial training, enabling a network trained on synthetic data to achieve significantly better depth estimation on domain-adapted images compared to real ones.
To realize the full potential of deep learning for medical imaging, large annotated datasets are required for training. Such datasets are difficult to acquire because labeled medical images are not usually available due to privacy issues, lack of experts available for annotation, underrepresentation of rare conditions and poor standardization. Lack of annotated data has been addressed in conventional vision applications using synthetic images refined via unsupervised adversarial training to look like real images. However, this approach is difficult to extend to general medical imaging because of the complex and diverse set of features found in real human tissues. We propose an alternative framework that uses a reverse flow, where adversarial training is used to make real medical images more like synthetic images, and hypothesize that clinically-relevant features can be preserved via self-regularization. These domain-adapted images can then be accurately interpreted by networks trained on large datasets of synthetic medical images. We test this approach for the notoriously difficult task of depth-estimation from endoscopy. We train a depth estimator on a large dataset of synthetic images generated using an accurate forward model of an endoscope and an anatomically-realistic colon. This network predicts significantly better depths when using synthetic-like domain-adapted images compared to the real images, confirming that the clinically-relevant features of depth are preserved.