Search papers, labs, and topics across Lattice.
The paper introduces EBuddy, a voice-guided workflow orchestrator that uses a finite state machine (FSM) to operationalize expert knowledge in tool-intensive industrial workflows. EBuddy interprets spoken requests within state-grounded constraints, coordinating heterogeneous resources like GUI software and collaborative robots. A pilot study on impeller blade repair preparation demonstrates that EBuddy significantly reduces process duration while maintaining repeatability and low operator burden.
Scale expert know-how in tool-intensive industrial workflows with a voice-guided system that cuts process time and boosts repeatability.
This paper presents EBuddy, a voice-guided workflow orchestrator for natural human-machine collaboration in industrial environments. EBuddy targets a recurrent bottleneck in tool-intensive workflows: expert know-how is effective but difficult to scale, and execution quality degrades when procedures are reconstructed ad hoc across operators and sessions. EBuddy operationalizes expert practice as a finite state machine (FSM) driven application that provides an interpretable decision frame at runtime (current state and admissible actions), so that spoken requests are interpreted within state-grounded constraints, while the system executes and monitors the corresponding tool interactions. Through modular workflow artifacts, EBuddy coordinates heterogeneous resources, including GUI-driven software and a collaborative robot, leveraging fully voice-based interaction through automatic speech recognition and intent understanding. An industrial pilot on impeller blade inspection and repair preparation for directed energy deposition (DED), realized by human-robot collaboration, shows substantial reductions in end-to-end process duration across onboarding, 3D scanning and processing, and repair program generation, while preserving repeatability and low operator burden.
