Search papers, labs, and topics across Lattice.
This paper introduces Guided Action Flow, an inference-time framework that enhances flow-matching vision-language-action policies by employing a learned action-chunk critic to guide a frozen SmolVLA policy during sampling. By leveraging real success and failure rollouts, the critic improves task success rates significantly, with single-task critics achieving up to 86.0% success on specific manipulation tasks. The findings highlight the potential of Q-guided inference in optimizing frozen policies while revealing challenges related to critic generalization and uncertainty-aware guidance.
A frozen policy can achieve up to 86% success in manipulation tasks through guided inference, underscoring the power of learned critics in real-time decision-making.
Flow-matching vision-language-action policies generate robot action chunks through an iterative transport process, creating an opportunity for test-time guidance without retraining the base policy. We study this opportunity in Guided Action Flow, an inference-time framework that keeps a pretrained SmolVLA policy frozen and uses a learned action-chunk critic to guide its reverse-time flow sampler. The critic is trained from real success and failure rollouts, can condition on task-description features from the frozen SmolVLA language pathway, and is used only through action gradients during sampling. We evaluate the approach on LIBERO manipulation tasks. A single-task critic improves success from 68.0% to 82.0% on one seed window and from 82.0% to 86.0% on another. A multi-family task-description critic improves validation success from 46.0% to 56.0%, while the locked held-out test gain is positive but modest, from 65.0% to 67.5%. These results support the feasibility of Q-guided inference for frozen flow-matching VLA policies, while showing that critic generalization and uncertainty-aware guidance remain the central bottlenecks.
