Search papers, labs, and topics across Lattice.
This paper introduces PVminerLLM2, an advanced set of LLMs designed for the structured extraction of patient-generated text, which is crucial for understanding patient experiences and improving care outcomes. By employing preference optimization techniques, including a token-level gated stabilization term and confusion-aware preference pair construction, the model effectively addresses token-critical errors that traditional supervised fine-tuning struggles with. The results show significant performance improvements over previous models, with gains of up to 4.43% in structured extraction tasks, indicating a robust advancement in processing patient voice data.
Preference optimization in PVminerLLM2 leads to a remarkable 4.43% improvement in structured extraction accuracy, tackling token-critical errors that have long hindered patient voice analysis.
Motivation: Patient-generated text contains critical information on patients' lived experiences, social context, and care engagement, but remains largely unstructured, limiting its use in patient-centered outcomes research. Prior work introduced the PV-Miner benchmark and PVMinerLLM models for structured extraction. However, supervised fine-tuning (SFT) alone struggles with rare, fine-grained, and unevenly distributed errors, particularly in token-critical structured outputs. Results: We present PVminerLLM2, an improved set of LLMs for structured patient voice extraction that applies preference optimization to address token-critical errors beyond the reach of supervised fine-tuning. Our method introduces (i) a preference objective with token-level gated stabilization term that prevents degradation of absolute token likelihood under preference optimization, and (ii) confusion-aware preference pair construction to better capture low-separation distinctions. We further incorporate token-importance weighting and inverse-frequency reweighing to address token imbalance and class skew. Across multiple model sizes, PVMinerLLM2 consistently outperforms strong baselines, achieving gains of up to 4.43% (Code), 3.50% (Sub-code), and 1.55% (Span), and outperforms baseline LLM trained with existing preference optimization methods. Availability and Implementation: The supplementary material, code, evaluation scripts, and trained models for PVminerLLM2 are publicly available at: https://github.com/Data-Mining-Lab-Yale/PVminerLLM2
