Search papers, labs, and topics across Lattice.
This paper introduces the Sampling-Based Retargeter (SBR), a novel gradient-free algorithm for kinematic hand retargeting that minimizes jitter in real-time teleoperation. By leveraging sampling-based control techniques, SBR outperformed traditional gradient-based methods in both simulation and a user study, achieving a task success rate of 54.1% and significantly reducing cognitive fatigue among operators. The findings highlight SBR's potential to enhance the quality of teleoperation data and improve user experience in robotic manipulation tasks.
SBR reduces cognitive fatigue while achieving a 54.1% task success rate, outperforming traditional methods in real-time kinematic retargeting.
Advances in learning-based robotic manipulation, such as Vision-Language-Action (VLA) models and Video Action Models (VAMs), heavily rely on high-quality teleoperation data. Their capabilities are strictly upper-bounded by the quality of the underlying human demonstrations. Current gradient-based retargeting algorithms often converge to different local minima, resulting in jitter that affects data quality and teleoperation experience. To address this, we introduce the Sampling-Based Retargeter (SBR), a novel gradient-free retargeting method drawn from the rich literature of sampling-based control and explicitly designed for low-jitter, real-time kinematic retargeting. We evaluate SBR both in simulation and through a rigorous real-world user study involving 18 participants performing 3 complex manipulation tasks. Compared to gradient-based baselines, SBR achieved the highest overall task success rate (54.1%) while significantly reducing operator cognitive fatigue, recording the lowest NASA-TLX workload score (36.4 out of 100). Ultimately, we establish SBR as a highly effective, intuitive retargeter for dexterous manipulation, providing the community with a rigorous benchmarking methodology to guide future retargeting research.
ETH
Stanford HAI