Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
To eliminate the high inference latency inherent to flow-based Vision-Language-Action (VLA) models, the authors develop RAVEL, an asynchronous framework that decouples heavy visual-language feature encoding from high-frequency action generation. By caching partially denoised action chunks across a rolling temporal buffer and routing real-time sensory data through a lightweight Fast Observation Pathway, the action expert can emit near-term actions with single-step latency. Across simulated and real-world manipulation tasks, this approach achieves responsive, high-frequency closed-loop control with significantly reduced latency while preserving full task success rates.
Multi-step flow-matching policies can achieve single-step control latencies by pipelining partially denoised action trajectories through an asynchronous rolling buffer.
Flow-based vision-language-action (VLA) models are highly effective for generalist robot manipulation, yet their reliance on computationally expensive VLM encoding and multi-step iterative action generation imposes a significant latency bottleneck. The resulting inference latency makes it difficult for robots to respond quickly, especially in dynamic environments. We address this limitation with RAVEL (Rolling Asynchronous VLA Enabling Low-Latency Control), an asynchronous inference framework that addresses the computational bottlenecks of both the VLM backbone and the action expert. To reduce the delay from multi-step action denoising, RAVEL allows near-term actions to be executed after a single denoising step by carrying partially denoised future actions forward in a rolling buffer. To avoid blocking on slow VLM encoding, RAVEL decouples VLM encoding from rolling action generation, allowing the action expert to operate continuously using the latest available VLM context, while a lightweight Fast Observation Pathway (FOP) directly conditions the action expert on current observations. Across simulated and real-world manipulation tasks, RAVEL consistently achieves substantially lower response latency while maintaining the task capability of the underlying VLA, enabling high-frequency and responsive closed-loop control.