Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
This paper introduces YOCO, a few-shot, fine-tuning-free calibration framework for dexterous teleoperation that addresses biases in low-cost motion-capture systems. By conditioning a HyperNet on a small set of paired raw and target poses, YOCO predicts LoRA-style updates for a frozen MANO hand-estimation module, enabling rapid, per-user calibration without retraining. Evaluation on synthetic and real-world data demonstrates YOCO's superiority in calibration efficiency, hand-state estimation quality, and teleoperation performance over uncalibrated inputs and standard baselines.
Dexterous teleoperation can now achieve high-fidelity hand-state estimation with just a few calibration poses, bypassing per-user model retraining.
Dexterous teleoperation requires reliable human-hand state estimations. However, common low-cost motion-capture gloves and markerless trackers often exhibit biases that vary across users, glove fit, and recording sessions, degrading retargeting and demonstration quality. We present YOCO, a fast few-shot, fine-tuning-free calibration framework that corrects biased hand-pose streams from a small set of paired raw and target poses. Instead of optimizing a separate model for every operator or session, YOCO conditions a calibration HyperNet on the paired examples and predicts LoRA-style updates for a frozen MANO hand-estimation module, turning per-user calibration into a lightweight feed-forward adaptation step while preserving the geometric prior of MANO and the efficiency of a compact estimator. We train YOCO with synthetic drift augmentations on InterHand2.6M and evaluate on augmented InterHand sequences, offline real glove data, and dexterous teleoperation tasks. Across these settings, YOCO improves calibration efficiency, hand-state estimation quality and teleoperation performance compared with uncalibrated input and standard calibration baselines.