Search papers, labs, and topics across Lattice.
This paper introduces LabRobFail, a comprehensive framework designed to enhance robotic failure analysis in chemical self-driving laboratories by addressing the lack of failure data and evaluation protocols. The framework includes LabRobFail-Sim, which simulates controllable failures across various levels, generating a dataset of over 20,000 trajectories and enabling fine-grained evaluation through LabRobFail-Bench. Key results show that the specialized vision-language model, LabRobFail-VLM, achieves significantly higher failure-detection and temporal-localization accuracy compared to general-purpose models, leading to improved task success rates in real-time applications.
LabRobFail reveals that a specialized vision-language model can boost robotic task success rates by up to 20% through enhanced failure understanding.
The deployment of embodied agents in self-driving laboratories could accelerate scientific discovery, yet their reliability is constrained by the irreversible and safety-critical nature of chemical experiments. Progress is further hindered by scarce failure data and the lack of fine-grained evaluation protocols. To address these challenges, we introduce LabRobFail, a failure-centric framework for learning and evaluating robotic failure analysis in chemical laboratories. LabRobFail-Sim injects controllable failures at the control, physics, and semantic levels, enabling the construction of LabRobFail-Data, which contains over 20,000 trajectories across 70+ task scenarios, five failure categories, and 11 fine-grained failure types. LabRobFail-Bench evaluates six capabilities spanning task understanding, failure detection, temporal localization, severity assessment, failure classification, and actionable correction. We further develop LabRobFail-VLM, a domain-specialized vision-language model that generates structured failure diagnoses and recovery instructions. On seen environments, it achieves 92.58% failure-detection accuracy and 85.58% temporal-localization accuracy, substantially outperforming general-purpose VLMs. When integrated as a real-time supervisor, it improves downstream VLA task success rates by 10-20 percentage points, demonstrating the value of fine-grained failure understanding for closed-loop recovery and reliable laboratory autonomy. Our code and data are available at https://github.com/Su-ISE-2001/SciRobo
