Search papers, labs, and topics across Lattice.
This paper tackles the critical challenge of evaluating the biological capabilities and risks posed by AI systems capable of conducting scientific tasks autonomously. By synthesizing current evidence and introducing biological agentic evaluations, the authors highlight how design choices in these evaluations can significantly influence the interpretation of results regarding AI risks. The findings underscore the need for careful documentation and scoring methods to ensure that policymakers and stakeholders can accurately assess the implications of AI evaluations in biological contexts.
Evaluation design choices can drastically alter the perceived risks of AI systems in biological research, revealing a hidden complexity that demands attention.
This paper addresses a rapidly emerging policy challenge: how to generate and interpret credible evidence about the biological capabilities and risks of AI scientists, or agentic AI systems capable of autonomously or collaboratively performing multi-step scientific tasks. As these systems enter real research workflows, decision-makers increasingly face evaluation results whose meaning depends on underlying design choices that are often implicit or under-documented. We synthesize current evidence on AI-enabled biological risks and introduce biological agentic evaluations as a promising, but interpretation-sensitive, tool for assessing these systems. Our central contribution is a set of practical, experience-grounded considerations -- drawing from our own evaluations -- that show how choices around defining, designing, running, scoring, and documenting evaluations materially shape what results do and do not imply about risk. The analysis is intended to help policymakers interpret biological evaluation outputs with appropriate caution; guide public and private funders toward high-leverage investments in AI-biology evaluation research; and support biosecurity practitioners assessing emerging AI systems. A secondary audience includes researchers designing or conducting agentic evaluations within frontier AI labs, AI providers, scientific institutions, and third-party evaluation organizations.
