Search papers, labs, and topics across Lattice.
Owl-AuraID is introduced as a software-hardware system that automates scientific instrument operation and data analysis by directly interacting with instrument GUIs, mimicking human expert workflows. It employs a skill-centric framework, integrating GUI operation (Type-1) and data analysis (Type-2) skills to execute end-to-end scientific workflows across diverse instruments. The system demonstrates broad applicability by automating ten categories of precision instruments and workflows, including spectral analysis, imaging, and crystallographic analysis, thus providing a foundation for autonomous laboratories.
Automating scientific instruments is now as easy as mimicking a human using the GUI, unlocking faster and more reproducible research.
Scientific discovery increasingly depends on high-throughput characterization, yet automation is hindered by proprietary GUIs and the limited generalizability of existing API-based systems. We present Owl-AuraID, a software-hardware collaborative embodied agent system that adopts a GUI-native paradigm to operate instruments through the same interfaces as human experts. Its skill-centric framework integrates Type-1 (GUI operation) and Type-2 (data analysis) skills into end-to-end workflows, connecting physical sample handling with scientific interpretation. Owl-AuraID demonstrates broad coverage across ten categories of precision instruments and diverse workflows, including multimodal spectral analysis, microscopic imaging, and crystallographic analysis, supporting modalities such as FTIR, NMR, AFM, and TGA. Overall, Owl-AuraID provides a practical, extensible foundation for autonomous laboratories and illustrates a path toward evolving laboratory intelligence through reusable operational and analytical skills. The code are available at https://github.com/OpenOwlab/AuraID.