Search papers, labs, and topics across Lattice.
This paper introduces AutoSpeed, a model-agnostic framework that enhances visuomotor policies by enabling stage-adaptive motion speed predictions without the need for explicit annotations. By treating future trajectories at varying speeds as optimization targets and employing a composite cost function, AutoSpeed effectively balances prediction error and temporal prediction horizons. The results demonstrate significant reductions in task execution time and improved success rates, with inferred motion speeds aligning closely with task complexity stages.
Task execution time can be drastically cut while improving success rates by adapting motion speeds to the complexity of manipulation stages鈥攏o annotations required.
Different stages of manipulation tasks exhibit varying levels of difficulty, suggesting stage-dependent motion speeds and temporal prediction horizons. However, existing IL-based visuomotor policies typically imitate the execution speed of expert demonstrations and operate with a fixed temporal prediction horizon, limiting flexibility and overall task throughput. In this paper, we introduce AutoSpeed, a model-agnostic learning framework that enables existing visuomotor policies to predict trajectories with stage-adaptive motion speeds, without requiring speed or stage annotations. We treat future trajectories at different speeds as candidate optimization targets, evaluate each candidate using a composite cost that trades off prediction error against prediction horizon, and optimize the policy toward the minimum-cost candidate. With a fixed-length action sequence, speed modulation adjusts the effective temporal prediction horizon: simple stages are executed faster with a longer prediction horizon, whereas complex stages are executed more slowly with a shorter prediction horizon. Specifically, we implement speed modulation in the frequency domain via the discrete cosine transform (DCT), which enables smooth, non-integer speed scaling and thus preserves motion continuity. Extensive evaluations show that AutoSpeed substantially reduces task execution time while also improving success rates. Under the AutoSpeed framework, the inferred motion speeds exhibit a strong correspondence with task stages.
