Search papers, labs, and topics across Lattice.
This paper introduces a receiver-centered, voice-driven adaptive handover system for collaborative robots, designed to enhance the ergonomics of tool transfer in human-robot interactions. By leveraging a large language model (LLM) for intention recognition and MediaPipe for real-time hand tracking, the system dynamically adjusts the robot's end-effector orientation to present tools in an optimal handle-first position. Experimental results show that this adaptive approach significantly reduces grasp delays and enhances user trust in the interaction, particularly regarding motion predictability and task simplicity.
Adaptive handover systems can drastically reduce grasp delays and improve user trust in human-robot interactions, especially with asymmetric tools.
Collaborative robots are increasingly sharing workspaces with human operators, making tool handover a frequent and safety-critical micro-interaction. However, traditional static handovers often lead to awkward grasps when handling asymmetric industrial tools. This paper presents a receiver-centered voice-driven adaptive handover system for mechanical tools, built on a Franka cobot. Using an LLM for intention recognition and MediaPipe for real-time 3D hand tracking, the framework dynamically adjusts the end-effector's orientation to present tools in an ergonomically optimal, handle-first pose. A within-subjects study compared this adaptive approach with an object-agnostic static baseline. The results demonstrate that the adaptive system reduces the grasp delay for asymmetric tools, improving the fluency of the interaction. Furthermore, the adaptive strategy improved specific trust-related perceptions, particularly motion predictability and perceived task simplicity.
