Search papers, labs, and topics across Lattice.
This paper introduces ProtoPilot, a self-evolving multi-agent system designed to automate the generation and execution of biological protocols while ensuring alignment between biological intent, quantitative procedures, and device constraints. The system was evaluated against a comprehensive benchmark of 294 tasks derived from expert protocols, achieving a remarkable 90.2% expert-preference rate and demonstrating significant improvements over existing solutions like OpenTrons-AI. The results indicate that ProtoPilot not only generates valid protocols and code but also effectively incorporates feedback from wet-lab experiments to refine its workflows, establishing a new standard for autonomous experimentation in synthetic biology.
ProtoPilot achieves a staggering 90.2% expert-preference rate in autonomous wet-lab experimentation, setting a new benchmark for protocol generation and execution.
Autonomous wet-lab experimentation requires more than plausible protocol text: biological intent, quantitative procedures, device constraints and experimental feedback must remain aligned from protocol and SOP design to code and physical execution. We developed ProtoPilot, a self-evolving multi-agent system, together with an expert-grounded benchmark and evaluation framework for testing this conversion as an experimental automation problem. The framework spans 294 synthetic-biology and molecular-biology tasks derived from 98 gold-standard protocols, wet-lab expert rubrics, device-level validity gates and real experimental tests. ProtoPilot incorporates layer-wise verifiability, multi-agent orchestration and a runtime-updated skill library to generate protocols, expand SOPs, synthesize SDK-compliant code and revise workflows from wet-lab feedback. It achieved a Top@3 expert-preference rate of 90.2%, an overall protocol-to-code gate pass rate of 89.5% and an Opentrons pass rate of 88.24%, compared with 32.35% for OpenTrons-AI. Wet-lab validation produced interpretable readouts, Sanger-confirmed products and feedback-corrected PCA-assembled DNA targets, establishing a verifiable route to autonomous experimentation. Together, these results show that the evaluation framework captures execution-relevant requirements for autonomous wet-lab automation, and that ProtoPilot can meet them by converting protocol and code generation into validated execution and feedback-guided revision.
