Advanced XR-Based 6-DOF Catheter Tracking System for Immersive Cardiac Intervention Training
This addresses the need for improved training tools for cardiologists performing catheter-based interventions, though it is incremental as it builds on existing XR and computer vision methods.
This paper tackled the problem of real-time 3D tracking and visualization of intracardiac echocardiography catheters for cardiac intervention training, developing a system with sub-millimeter accuracy and roll angle measurement, but found that 3D visualization did not necessarily outperform 2D views in an experimental study with six participants.
Extended Reality (XR) technologies are gaining traction as effective tools for medical training and procedural guidance, particularly in complex cardiac interventions. This paper presents a novel system for real-time 3D tracking and visualization of intracardiac echocardiography (ICE) catheters, with precise measurement of the roll angle. A custom 3D-printed setup, featuring orthogonal cameras, captures biplane video of the catheter, while a specialized computer vision algorithm reconstructs its 3D trajectory, localizing the tip with sub-millimeter accuracy and tracking the roll angle in real-time. The system's data is integrated into an interactive Unity-based environment, rendered through the Meta Quest 3 XR headset, combining a dynamically tracked catheter with a patient-specific 3D heart model. This immersive environment allows the testing of the importance of 3D depth perception, in comparison to 2D projections, as a form of visualization in XR. Our experimental study, conducted using the ICE catheter with six participants, suggests that 3D visualization is not necessarily beneficial over 2D views offered by the XR system; although all cardiologists saw its utility for pre-operative training, planning, and intra-operative guidance. The proposed system qualitatively shows great promise in transforming catheter-based interventions, particularly ICE procedures, by improving visualization, interactivity, and skill development.