Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a markerless interaction framework for gaze-based robot placement that emphasizes task-oriented accuracy over traditional pose metrics. By developing a dedicated cross-device dataset and employing Graph-based Reference Selection, the authors benchmark multiple alignment pipelines and introduce a novel metric, Gaze-Surface Intersection Error (GSIE), to measure spatial error in gaze-specified targets. The findings reveal that conventional pose metrics can mislead optimal alignment choices, highlighting the necessity of evaluating gaze-based manipulation through a task-centric lens.
Conventional pose metrics can misguide robot placement accuracy, with task-level evaluation revealing surprising misalignments in gaze-based interactions.
Gaze-based assistive manipulation typically supports object selection, while arbitrary-position placement requires accurate spatial alignment between the headset and robot. However, for gaze-based manipulation, pose accuracy does not necessarily translate into task accuracy: translational and rotational errors jointly affect the transformed gaze ray and may compensate for each other. To study cross-device alignment from this task-oriented perspective, we present a markerless interaction framework and a dedicated cross-device dataset. We propose Graph-based Reference Selection to address sparse robot references. We further develop and benchmark multiple task-specific alignment pipelines under a unified protocol. Specifically, we introduce Gaze--Surface Intersection Error (GSIE), which directly measures the spatial error of the gaze-specified target. Experiments show that alignment methods ranked highly by conventional pose metrics are not always optimal in GSIE, demonstrating the importance of evaluating gaze-based manipulation at the task level.