Electrocardiogram Report Generation and Question Answering via Retrieval-Augmented Self-Supervised Modeling
This addresses the challenge of ECG interpretation in cardiology, which requires specialized expertise and time, offering a scalable solution to potentially improve patient care, though it appears incremental as it combines existing techniques like self-supervised learning and LLMs.
The paper tackled the problem of interpreting electrocardiograms (ECGs) and generating reports by proposing ECG-ReGen, a retrieval-based method that achieved superior performance on PTB-XL and MIMIC-IV-ECG datasets for report generation and competitive results on ECG-QA for question answering.
Interpreting electrocardiograms (ECGs) and generating comprehensive reports remain challenging tasks in cardiology, often requiring specialized expertise and significant time investment. To address these critical issues, we propose ECG-ReGen, a retrieval-based approach for ECG-to-text report generation and question answering. Our method leverages a self-supervised learning for the ECG encoder, enabling efficient similarity searches and report retrieval. By combining pre-training with dynamic retrieval and Large Language Model (LLM)-based refinement, ECG-ReGen effectively analyzes ECG data and answers related queries, with the potential of improving patient care. Experiments conducted on the PTB-XL and MIMIC-IV-ECG datasets demonstrate superior performance in both in-domain and cross-domain scenarios for report generation. Furthermore, our approach exhibits competitive performance on ECG-QA dataset compared to fully supervised methods when utilizing off-the-shelf LLMs for zero-shot question answering. This approach, effectively combining self-supervised encoder and LLMs, offers a scalable and efficient solution for accurate ECG interpretation, holding significant potential to enhance clinical decision-making.