CVMar 22, 2023

Distribution Aligned Diffusion and Prototype-guided network for Unsupervised Domain Adaptive Segmentation

arXiv:2303.12313v34 citationsh-index: 34
Originality Incremental advance
AI Analysis

This addresses domain shift problems in medical imaging, offering a novel application of diffusion models for segmentation, though it is incremental in adapting existing techniques to a specific domain.

The paper tackles unsupervised domain adaptive segmentation in medical images by proposing a Diffusion-based and Prototype-guided network (DP-Net), which outperforms state-of-the-art methods on fundus datasets.

The Diffusion Probabilistic Model (DPM) has emerged as a highly effective generative model in the field of computer vision. Its intermediate latent vectors offer rich semantic information, making it an attractive option for various downstream tasks such as segmentation and detection. In order to explore its potential further, we have taken a step forward and considered a more complex scenario in the medical image domain, specifically, under an unsupervised adaptation condition. To this end, we propose a Diffusion-based and Prototype-guided network (DP-Net) for unsupervised domain adaptive segmentation. Concretely, our DP-Net consists of two stages: 1) Distribution Aligned Diffusion (DADiff), which involves training a domain discriminator to minimize the difference between the intermediate features generated by the DPM, thereby aligning the inter-domain distribution; and 2) Prototype-guided Consistency Learning (PCL), which utilizes feature centroids as prototypes and applies a prototype-guided loss to ensure that the segmentor learns consistent content from both source and target domains. Our approach is evaluated on fundus datasets through a series of experiments, which demonstrate that the performance of the proposed method is reliable and outperforms state-of-the-art methods. Our work presents a promising direction for using DPM in complex medical image scenarios, opening up new possibilities for further research in medical imaging.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes