Search papers, labs, and topics across Lattice.
The paper introduces AnchorRefine, a hierarchical framework for Vision-Language-Action (VLA) models that decomposes action generation into trajectory anchor planning and residual refinement. This factorization addresses the issue of monolithic action spaces where large motions overshadow critical corrective signals. Experiments on robotic manipulation benchmarks show that AnchorRefine improves both regression-based and diffusion-based VLA models, achieving significant gains in both simulated and real-world success rates.
Decomposing robotic manipulation into coarse trajectory anchors and fine-grained residual refinement boosts real-world success rates by 18%, suggesting a more human-like approach to VLA control.
Precision-critical manipulation requires both global trajectory organization and local execution correction, yet most vision-language-action (VLA) policies generate actions within a single unified space. This monolithic formulation forces macro-level transport and micro-level refinement to be optimized under the same objective, causing large motions to dominate learning while suppressing small but failure-critical corrective signals. In contrast, human manipulation is structured by global movement planning together with continuous local adjustment during execution. Motivated by this principle, we propose AnchorRefine, a hierarchical framework that factorizes VLA action modeling into trajectory anchor and residual refinement. The anchor planner predicts a coarse motion scaffold, while the refinement module corrects execution-level deviations to improve geometric and contact precision. We further introduce a decision-aware gripper refinement mechanism to better capture the discrete and boundary-sensitive nature of gripper control. Experiments on LIBERO, CALVIN, and real-robot tasks demonstrate that AnchorRefine consistently improves both regression-based and diffusion-based VLA backbones, yielding gains of up to 7.8% in simulation success rate and 18% in real-world success rate.