Search papers, labs, and topics across Lattice.
The paper introduces XS-VLA, a two-stage framework that enhances lightweight robotic control by coupling coarse-grained spatial distillation with Latent Flow Matching. This approach addresses the limitations of lightweight models, which often struggle with spatial awareness, by fine-tuning a smaller model on spatial descriptions and employing a Conditional Variational Autoencoder for action distribution modeling. XS-VLA achieves state-of-the-art performance on the LIBERO benchmark, improving success rates by up to 7.2% while executing missions 3.2 times faster than previous methods with similar parameter counts.
XS-VLA outperforms larger models by leveraging spatial distillation and generative flow control, achieving remarkable efficiency in robotic manipulation.
Large Vision-Language Models (LVLMs) have shown strong multimodal understanding and spatial grounding, but their computational cost limits real-time robotic control. In contrast, lightweight models are suitable for edge deployment but often suffer from "spatial blindness", namely weak native spatial prediction ability. Training Vision-Language-Action (VLA) models on mixed human demonstrations can also degrade policy performance due to highly diverse behaviors. To address these limitations, we propose XS-VLA, a two-stage framework for efficient and spatially grounded robotic manipulation. First, we distill spatial semantic knowledge from Qwen3-VL-4B into the SmolVLM2-0.25B backbone by fine-tuning on curated coarse-grained spatial descriptions, turning the lightweight model into a spatially grounded engine. Second, we use this enhanced backbone to condition a Latent Flow Matching policy. Unlike deterministic controllers, our policy combines a Conditional Variational Autoencoder (CVAE) with Flow Matching dynamics to model complex multimodal action distributions. On the LIBERO benchmark, XS-VLA achieves state-of-the-art performance among models with fewer than 0.5B parameters. It improves average success rates by up to 7.2 percent, including a 23 percent gain on LIBERO-Long, over the SmolVLA 0.25B baseline, and outperforms the larger 2.2B vanilla SmolVLA. Ablations show that spatial tuning and generative latent flow control substantially improve lightweight VLA performance, delivering a 3.2 times speedup in mission execution over the previous lightweight flow matching policy.
Tsinghua AI