Towards Integrating Epistemic Uncertainty Estimation into the Radiotherapy Workflow
This addresses a critical problem for clinical radiotherapy workflows by improving model reliability in out-of-distribution detection, though it is incremental as it builds on existing uncertainty estimation methods.
The study tackled the reliability of deep learning models for organ-at-risk contouring in radiotherapy by integrating epistemic uncertainty estimation to detect out-of-distribution scenarios, achieving an AUC-ROC of 0.95 with specificity of 0.95 and sensitivity of 0.92 for implant cases.
The precision of contouring target structures and organs-at-risk (OAR) in radiotherapy planning is crucial for ensuring treatment efficacy and patient safety. Recent advancements in deep learning (DL) have significantly improved OAR contouring performance, yet the reliability of these models, especially in the presence of out-of-distribution (OOD) scenarios, remains a concern in clinical settings. This application study explores the integration of epistemic uncertainty estimation within the OAR contouring workflow to enable OOD detection in clinically relevant scenarios, using specifically compiled data. Furthermore, we introduce an advanced statistical method for OOD detection to enhance the methodological framework of uncertainty estimation. Our empirical evaluation demonstrates that epistemic uncertainty estimation is effective in identifying instances where model predictions are unreliable and may require an expert review. Notably, our approach achieves an AUC-ROC of 0.95 for OOD detection, with a specificity of 0.95 and a sensitivity of 0.92 for implant cases, underscoring its efficacy. This study addresses significant gaps in the current research landscape, such as the lack of ground truth for uncertainty estimation and limited empirical evaluations. Additionally, it provides a clinically relevant application of epistemic uncertainty estimation in an FDA-approved and widely used clinical solution for OAR segmentation from Varian, a Siemens Healthineers company, highlighting its practical benefits.