From Documents to Spans: Code-Centric Learning for LLM-based ICD Coding
This addresses computational and generalization issues in automated medical coding for healthcare systems, representing a domain-specific incremental improvement.
The paper tackles the challenge of fine-tuning large language models for ICD coding by proposing Code-Centric Learning, which shifts supervision from full clinical documents to short evidence spans, resulting in reduced training cost, improved accuracy on unseen codes, and preserved interpretability while enabling small-scale LLMs to achieve performance comparable to larger proprietary models.
ICD coding is a critical yet challenging task in healthcare. Recently, LLM-based methods demonstrate stronger generalization than discriminative methods in ICD coding. However, fine-tuning LLMs for ICD coding faces three major challenges. First, existing public ICD coding datasets provide limited coverage of the ICD code space, restricting a model's ability to generalize to unseen codes. Second, naive fine-tuning diminishes the interpretability of LLMs, as few public datasets contain explicit supporting evidence for assigned codes. Third, ICD coding typically involves long clinical documents, making fine-tuning LLMs computationally expensive. To address these issues, we propose Code-Centric Learning, a training framework that shifts supervision from full clinical documents to scalable, short evidence spans. The key idea of this framework is that span-level learning improves LLMs' ability to perform document-level ICD coding. Our proposed framework consists of a mixed training strategy and code-centric data expansion, which substantially reduces training cost, improves accuracy on unseen ICD codes and preserves interpretability. Under the same LLM backbone, our method substantially outperforms strong baselines. Notably, our method enables small-scale LLMs to achieve performance comparable to much larger proprietary models, demonstrating its effectiveness and potential for fully automated ICD coding.