Toward Scalable and Transparent Multimodal Analytics to Study Standard Medical Procedures: Linking Hand Movement, Proximity, and Gaze Data
This research addresses the need for objective evaluation of procedural competence in medical education, though it appears incremental as it applies existing MMLA methods to a specific clinical context.
The study tackled the problem of analyzing behavioral dynamics during the ABCDE procedure in nursing education by using multimodal learning analytics (MMLA) to link hand movement, proximity, and gaze data, resulting in the identification of four distinct procedural phases based on patterns of visual attention, hand movements, and proximity.
This study employed multimodal learning analytics (MMLA) to analyze behavioral dynamics during the ABCDE procedure in nursing education, focusing on gaze entropy, hand movement velocities, and proximity measures. Utilizing accelerometers and eye-tracking techniques, behaviorgrams were generated to depict various procedural phases. Results identified four primary phases characterized by distinct patterns of visual attention, hand movements, and proximity to the patient or instruments. The findings suggest that MMLA can offer valuable insights into procedural competence in medical education. This research underscores the potential of MMLA to provide detailed, objective evaluations of clinical procedures and their inherent complexities.