Search papers, labs, and topics across Lattice.
To address the failure modes of clinical LLMs over dynamically updated medical protocols, the authors introduce SentryLine, a living-guideline question-answering framework evaluated on ASCOBench, an expert-annotated 405-dialogue oncology benchmark. The system abandons standard dense embeddings in favor of a vectorless hierarchical retrieval pipeline augmented with factual verification, temporal tracking, and explicit document-drift detection. Across three frontier LLM backbones, SentryLine consistently outperforms existing retrieval baselines and ASCO's official guideline assistant, achieving its largest margins on multi-hop reasoning and role-conditioned clinical queries.
Living clinical guidelines continuously drift, yet pairing vectorless hierarchical retrieval with explicit temporal verification enables models to outperform ASCO's own assistant on multi-hop oncology reasoning without embedding drift.
Oncology care operates at constant pressure of absorbing rapidly evolving evidence base in biomedicine. The American Society of Clinical Oncology (ASCO) addresses this through living guidelines, but the format introduces a new burden: any recommendation can change at any point, across multiple versioned documents. We present SENTRYLINE, a living guideline-aware clinical question answering system. SENTRYLINE retrieves guideline passages through a vectorless hierarchical RAG pipeline and returns a role-specific answer with inline citations, factual and temporal verification reports, and drift detection notes that surface when a guideline has been updated. We construct ASCOBENCH, a benchmark of 405 three-turn conversations across four question categories with gold answers from expert annotators(clinicians), and use test set to evaluate SENTRYLINE against five baselines under an LLM-as-judge framework. Experiments across three generation backbones show consistent improvements over four retrieval baselines and ASCO's guideline assistant, with particularly strong gains on Reasoning and Role-Specific questions where multi-hop synthesis and register adaptation are required
