Search papers, labs, and topics across Lattice.
The paper introduces Tele-Catch, a framework for dexterous robot teleoperation of dynamic object catching, fusing human input with autonomous diffusion policies. A dynamics-aware adaptive integration mechanism (DAIM) modulates control based on object state, while DP-U3R enhances policy robustness using unsupervised geometric representations from point clouds. Experiments show Tele-Catch improves accuracy and robustness across different hand embodiments and object categories.
Robots can now catch dynamically moving objects with human-level dexterity, thanks to a shared autonomy framework that intelligently blends teleoperation with learned diffusion policies.
Teleoperation is a key paradigm for transferring human dexterity to robots, yet most prior work targets objects that are initially static, such as grasping or manipulation. Dynamic object catch, where objects move before contact, remains underexplored. Pure teleoperation in this task often fails due to timing, pose, and force errors, highlighting the need for shared autonomy that combines human input with autonomous policies. To this end, we present Tele-Catch, a systematic framework for dexterous hand teleoperation in dynamic object catching. At its core, we design DAIM, a dynamics-aware adaptive integration mechanism that realizes shared autonomy by fusing glove-based teleoperation signals into the diffusion policy denoising process. It adaptively modulates control based on the interaction object state. To improve policy robustness, we introduce DP-U3R, which integrates unsupervised geometric representations from point cloud observations into diffusion policy learning, enabling geometry-aware decision making. Extensive experiments demonstrate that Tele-Catch significantly improves accuracy and robustness in dynamic catching tasks, while also exhibiting consistent gains across distinct dexterous hand embodiments and previously unseen object categories.
