Semi-Supervised 3D Medical Segmentation from 2D Natural Images Pretrained Model
It addresses the challenge of data scarcity in medical imaging for researchers and practitioners, though it is incremental as it builds on existing semi-supervised and transfer learning techniques.
This paper tackles the problem of 3D medical image segmentation with limited labeled data by transferring knowledge from 2D natural image pretrained models, achieving state-of-the-art performance and outperforming thirteen existing semi-supervised methods across multiple datasets.
This paper explores the transfer of knowledge from general vision models pretrained on 2D natural images to improve 3D medical image segmentation. We focus on the semi-supervised setting, where only a few labeled 3D medical images are available, along with a large set of unlabeled images. To tackle this, we propose a model-agnostic framework that progressively distills knowledge from a 2D pretrained model to a 3D segmentation model trained from scratch. Our approach, M&N, involves iterative co-training of the two models using pseudo-masks generated by each other, along with our proposed learning rate guided sampling that adaptively adjusts the proportion of labeled and unlabeled data in each training batch to align with the models' prediction accuracy and stability, minimizing the adverse effect caused by inaccurate pseudo-masks. Extensive experiments on multiple publicly available datasets demonstrate that M&N achieves state-of-the-art performance, outperforming thirteen existing semi-supervised segmentation approaches under all different settings. Importantly, ablation studies show that M&N remains model-agnostic, allowing seamless integration with different architectures. This ensures its adaptability as more advanced models emerge. The code is available at https://github.com/pakheiyeung/M-N.