Search papers, labs, and topics across Lattice.
This paper introduces EpiBench, a novel benchmark designed to evaluate the ability of large language models (LLMs) to understand epitopes in the context of antibody drug discovery. By incorporating 1,609 curated samples and five interconnected tasks, EpiBench assesses LLM performance on epitope reasoning, revealing that while LLMs can capture some epitope-related signals, they struggle with antibody-specific sequence grounding and biologically relevant reasoning. The findings highlight the limitations of current LLMs in this domain and underscore the need for improved models to facilitate reliable antibody discovery processes.
Current LLMs only partially grasp epitope information, revealing significant gaps in their utility for antibody drug discovery.
Epitopes determine where antibodies bind antigens and shape downstream therapeutic properties such as functional blockade and escape resistance, making epitope understanding central to antibody drug discovery. Although large language models (LLMs) have shown strong biomedical reasoning ability, it remains unclear whether they can infer epitope information directly from antigen and antibody sequences. Existing epitope resources typically focus on isolated prediction tasks or rely on specialized structural settings, while general protein benchmarks do not evaluate epitope-centered decisions across the antibody development workflow. To address this gap, we introduce EpiBench, a closed-book, sequence-based, and automatically scorable benchmark for evaluating epitope reasoning in LLMs. EpiBench contains 1,609 curated samples grounded in structural antibody--antigen contacts, curated functional B-cell assays, and deep mutational scanning escape measurements. It covers five connected tasks: targetable region discovery, antibody-conditioned epitope identification, epitope binning, functional epitope assessment, and antibody escape assessment, with controlled sampling to reduce shortcut-based evaluation artifacts. We evaluate nine general-purpose LLMs and analyze their behavior through task-specific baselines, antigen length stratification, explicit-reasoning comparison, and failure-mode inspection. The results show that current LLMs capture partial epitope-related signals but remain limited in antibody-specific sequence grounding, long-context residue localization, and biologically grounded reasoning. Therefore, EpiBench provides a diagnostic testbed for measuring and improving sequence-aware biomedical LLMs toward reliable LLM-assisted antibody discovery.
