Search papers, labs, and topics across Lattice.
This study introduces a question-type-specific large language model (LLM) framework tailored for the BioASQ 14b Task B, enhancing the robustness and evidence grounding of biomedical question answering. By employing distinct inference strategies for yes/no, factoid, and list questions, the framework optimizes decision-making processes and improves accuracy in entity identification and evidence integration. The approach achieved first place in the factoid subtask of Batch 4 during official evaluations, underscoring its effectiveness in addressing the unique challenges of biomedical queries.
A novel LLM framework that adapts inference strategies based on question type leads to superior performance in biomedical question answering, clinching first place in a competitive evaluation.
Biomedical question answering requires not only accurate extraction of information from scientific literature but also reliable integration of evidence across multiple documents. This study presents a question-type-specific large language model (LLM) framework for BioASQ 14b Task B, designed to improve answer robustness and evidence grounding in biomedical question answering. Rather than applying a single prompting strategy to all questions, the framework selects different inference procedures for yes/no, factoid, and list questions according to their distinct reasoning and evaluation requirements. For yes/no questions, snippet shuffling and self-reflection are used to reduce sensitivity to evidence ordering and improve decision stability. For factoid questions, full-snippet input is combined with chain-of-thought-based in-context learning to support accurate biomedical entity identification. For list questions, a multi-agent architecture is employed, in which evidence extraction, candidate generation, answer verification, and final aggregation are handled collaboratively. Preliminary experiments on BioASQ 13b were used to identify effective inference strategies for each question type, and the resulting framework was subsequently evaluated in the official BioASQ 14b Task B challenge. In the official evaluation, our framework showed competitive performance across multiple batches and achieved first place in the factoid subtask of Batch 4. These results demonstrate the effectiveness of combining question-type-specific inference, ensemble prediction, and agent-based verification for reliable biomedical question answering.
