CVJun 6, 2023

Conditional Diffusion Models for Weakly Supervised Medical Image Segmentation

arXiv:2306.03878v219 citationsh-index: 39
Originality Incremental advance
AI Analysis

This work addresses medical image segmentation for healthcare applications with limited annotations, representing an incremental advance in applying diffusion models to this domain.

The authors tackled weakly supervised medical image segmentation by using conditional diffusion models to generate prediction masks from image-level annotations, achieving state-of-the-art performance on two public datasets with improved time efficiency.

Recent advances in denoising diffusion probabilistic models have shown great success in image synthesis tasks. While there are already works exploring the potential of this powerful tool in image semantic segmentation, its application in weakly supervised semantic segmentation (WSSS) remains relatively under-explored. Observing that conditional diffusion models (CDM) is capable of generating images subject to specific distributions, in this work, we utilize category-aware semantic information underlied in CDM to get the prediction mask of the target object with only image-level annotations. More specifically, we locate the desired class by approximating the derivative of the output of CDM w.r.t the input condition. Our method is different from previous diffusion model methods with guidance from an external classifier, which accumulates noises in the background during the reconstruction process. Our method outperforms state-of-the-art CAM and diffusion model methods on two public medical image segmentation datasets, which demonstrates that CDM is a promising tool in WSSS. Also, experiment shows our method is more time-efficient than existing diffusion model methods, making it practical for wider applications.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes