OpenRC: An Open-Source Robotic Colonoscopy Framework for Multimodal Data Acquisition and Autonomy Research
For researchers in robotic colonoscopy and surgical autonomy, OpenRC addresses the lack of a reproducible platform for studying closed-loop control and multimodal data acquisition.
OpenRC is an open-source robotic colonoscopy framework that enables simultaneous recording of video, operator commands, actuation state, and distal tip pose, validated with a multimodal dataset of 1,894 teleoperated episodes (~19 hours) across 10 task variations. It provides a reproducible foundation for research in multimodal robotic colonoscopy and surgical autonomy.
Colorectal cancer screening critically depends on colonoscopy, yet existing platforms offer limited support for systematically studying the coupled dynamics of operator control, instrument motion, and visual feedback. This gap restricts reproducible closed-loop research in robotic colonoscopy, medical imaging, and emerging vision-language-action (VLA) learning paradigms. To address this challenge, we present OpenRC, an open-source modular robotic colonoscopy framework that retrofits conventional scopes while preserving clinical workflow. The framework supports simultaneous recording of video, operator commands, actuation state, and distal tip pose. We experimentally validated motion consistency and quantified cross-modal latency across sensing streams. Using this platform, we collected a multimodal dataset comprising 1,894 teleoperated episodes ~19 hours across 10 structured task variations of routine navigation, failure events, and recovery behaviors. By unifying open hardware and an aligned multimodal dataset, OpenRC provides a reproducible foundation for research in multimodal robotic colonoscopy and surgical autonomy.