Search papers, labs, and topics across Lattice.
This paper introduces ProtoAct, a framework that transforms biological wet-lab protocols into actionable sequences for robots, addressing the challenge of implicit context in traditional protocols. By leveraging ProtoRAG for context-sensitive parsing, RefineChecker for step validation, and ActSchema for structured output, ProtoAct effectively bridges the gap between human-readable procedures and robotic execution. Evaluation shows that ProtoAct can be adapted across various large language models, with its components significantly enhancing the accuracy and reliability of robotic task execution in both simulated and real-world environments.
ProtoAct turns complex biological protocols into precise robotic actions, enabling seamless execution of lab procedures by machines.
Biological wet-lab protocols are written for trained researchers and often leave routine operations, state-dependent conditions, and contextual parameters implicit, making them difficult to translate into robot-executable actions. We present ProtoAct, a structured protocol-grounding framework that converts free-form biological procedures into state-aware, embodiment-ready action sequences. ProtoAct uses ProtoRAG to retrieve manually annotated examples for context-sensitive parsing, employs RefineChecker to detect and revise missing or inconsistent steps, and applies ActSchema to map the refined procedure into constrained JSON function sequences. We further introduce BioP2E, for which we manually annotate 22 cell-culture protocols into 258 monitoring conditions, 910 executable subtasks, and 962 grounded action calls. Evaluation across seven large language models demonstrates that ProtoAct can be effectively instantiated with different backbones. Ablations confirm that retrieval, posterior checking, and schema constraints make complementary contributions. The parsed subtasks further support demonstration collection and VLA model training, enabling successful execution in both simulation and real-robot settings. ProtoAct thus provides a practical interface between biological protocol understanding and embodied robotic execution.
