Dynamic Q&A of Clinical Documents with Large Language Models
This addresses the challenge of manual data extraction from clinical notes for healthcare professionals, though it appears incremental as it applies existing LLM methods to a specific domain.
The paper tackles the problem of extracting information from complex electronic health records by developing a natural language interface using large language models for dynamic question-answering on clinical notes, with experiments showing Wizard Vicuna achieving superior accuracy and model optimization improving latency by approximately 48 times.
Electronic health records (EHRs) house crucial patient data in clinical notes. As these notes grow in volume and complexity, manual extraction becomes challenging. This work introduces a natural language interface using large language models (LLMs) for dynamic question-answering on clinical notes. Our chatbot, powered by Langchain and transformer-based LLMs, allows users to query in natural language, receiving relevant answers from clinical notes. Experiments, utilizing various embedding models and advanced LLMs, show Wizard Vicuna's superior accuracy, albeit with high compute demands. Model optimization, including weight quantization, improves latency by approximately 48 times. Promising results indicate potential, yet challenges such as model hallucinations and limited diverse medical case evaluations remain. Addressing these gaps is crucial for unlocking the value in clinical notes and advancing AI-driven clinical decision-making.