Search papers, labs, and topics across Lattice.
This paper introduces Code-Centric Learning, a training framework for LLMs that shifts supervision from full clinical documents to short, evidence spans to improve ICD coding. The framework uses a mixed training strategy and code-centric data expansion to address challenges of limited data coverage, interpretability, and computational cost associated with fine-tuning LLMs for ICD coding. Experiments show that this approach improves accuracy on unseen ICD codes, preserves interpretability, reduces training costs, and enables smaller LLMs to achieve performance comparable to larger proprietary models.
Unlock the power of small LLMs for ICD coding: Code-Centric Learning lets them rival the performance of much larger proprietary models.
ICD coding is a critical yet challenging task in healthcare. Recently, LLM-based methods demonstrate stronger generalization than discriminative methods in ICD coding. However, fine-tuning LLMs for ICD coding faces three major challenges. First, existing public ICD coding datasets provide limited coverage of the ICD code space, restricting a model's ability to generalize to unseen codes. Second, naive fine-tuning diminishes the interpretability of LLMs, as few public datasets contain explicit supporting evidence for assigned codes. Third, ICD coding typically involves long clinical documents, making fine-tuning LLMs computationally expensive. To address these issues, we propose Code-Centric Learning, a training framework that shifts supervision from full clinical documents to scalable, short evidence spans. The key idea of this framework is that span-level learning improves LLMs' ability to perform document-level ICD coding. Our proposed framework consists of a mixed training strategy and code-centric data expansion, which substantially reduces training cost, improves accuracy on unseen ICD codes and preserves interpretability. Under the same LLM backbone, our method substantially outperforms strong baselines. Notably, our method enables small-scale LLMs to achieve performance comparable to much larger proprietary models, demonstrating its effectiveness and potential for fully automated ICD coding.
