Search papers, labs, and topics across Lattice.
This study investigates the dynamics of human vocal guidance in drone teleoperation, revealing that spontaneous vocal commands can be categorized into three distinct phases: Orientation, Approach, and Adjustment. By employing motion capture and speech data analysis across two experimental setups, the authors demonstrate that these phases are consistently marked by specific kinematic and linguistic features, validated through statistical methods. The findings suggest that this three-phase structure is a fundamental aspect of human spatial guidance, with implications for enhancing adaptive control in voice-guided robotic systems.
Spontaneous vocal guidance in drone teleoperation reveals a three-phase structure that could revolutionize how we design adaptive control systems for voice-operated robots.
Voice-guided teleoperation requires systems that adapt to the evolving dynamics of human guidance. Yet most voice-controlled robot systems treat spoken commands as a stationary stream, ignoring how the guide's communicative behavior changes as the task progresses. Using motion capture and speech data from two experimental configurations, humanhuman guidance (finger pointing, N =10 dyads) and humandrone teleoperation (gamepad control, N =29 dyads), we show that spontaneous vocal guidance consistently organizes into three kinematically and linguistically distinct phases: Orientation, Approach, and Adjustment. These phases are identified automatically via change point detection on 3D trajectory signals, and validated statistically (Kruskal-Wallis, p<.001). Three lexical families replicate across configurations: rotation vocabulary marks Orientation, translation vocabulary is scarce there, and attenuators accumulate toward Adjustment. Together with inter-utterance silence, these cues mark the Orientation boundary that speech rate alone leaves unmarked. The same three-phase structure emerges in both configurations despite radically different motor interfaces, suggesting it is an intrinsic property of human spatial guidance rather than an artifact of the experimental setup. We discuss implications for OAA-aware adaptive control in voice-guided teleoperation.
