Search papers, labs, and topics across Lattice.
This study addresses the verbose context problem in medical records, which hampers efficient cohort-level analysis due to token-inefficient textual representations. By introducing PopMedQA, a benchmark focused on computational tasks involving longitudinal patient records, the authors reveal that existing domain-independent methods are inadequate for overcoming this challenge. Their findings highlight the potential for leveraging domain-specific structures in language model inputs to enhance reasoning capabilities in population health contexts.
Domain-independent methods fall short in tackling the verbose context problem, revealing a critical need for domain-specific strategies in medical data analysis.
The verbose context problem occurs when structured concepts have token-inefficient textual representations. This bottleneck is acute in population health: cohort-level analysis of longitudinal patient records requires reasoning over thousands of medically-coded events, often exceeding 400K tokens in total. We present PopMedQA, a benchmark isolating this problem through computational tasks on groups of longitudinal patient records. We construct the benchmark using neopatient, a new library for language-controlled generation of artificial patient records. Through extensive ablations -- including prompting strategies, prompt compression, and agentic decomposition -- we find that domain-independent methods fail to alleviate the verbose context problem. There remains significant opportunity to exploit domain-specific structure in language model inputs for population-scale reasoning.
