HiLWS: A Human-in-the-Loop Weak Supervision Framework for Curating Clinical and Home Video Data for Neurological Assessment
This work addresses the challenge of scalable video-based assessment of motor symptoms for neurological conditions like Parkinson's disease, but it is incremental as it builds on existing weak supervision methods with a novel cascaded approach.
The paper tackled the problem of curating and annotating hand motor task videos from clinical and home settings for neurological assessment, particularly in Parkinson's disease, by introducing HiLWS, a cascaded human-in-the-loop weak supervision framework, which revealed key failure modes in home-recorded data and emphasized context-sensitive curation strategies.
Video-based assessment of motor symptoms in conditions such as Parkinson's disease (PD) offers a scalable alternative to in-clinic evaluations, but home-recorded videos introduce significant challenges, including visual degradation, inconsistent task execution, annotation noise, and domain shifts. We present HiLWS, a cascaded human-in-the-loop weak supervision framework for curating and annotating hand motor task videos from both clinical and home settings. Unlike conventional single-stage weak supervision methods, HiLWS employs a novel cascaded approach, first applies weak supervision to aggregate expert-provided annotations into probabilistic labels, which are then used to train machine learning models. Model predictions, combined with expert input, are subsequently refined through a second stage of weak supervision. The complete pipeline includes quality filtering, optimized pose estimation, and task-specific segment extraction, complemented by context-sensitive evaluation metrics that assess both visual fidelity and clinical relevance by prioritizing ambiguous cases for expert review. Our findings reveal key failure modes in home recorded data and emphasize the importance of context-sensitive curation strategies for robust medical video analysis.