Search papers, labs, and topics across Lattice.
Stanford HAICenter for AI ResearchDTUHanoi University of Science and TechnologyHessian.AIIMPRS-IS * Equal ContributorsKAISTMonashProject LeadsResearch Department SAIROLStuttgartTogetherTU DarmstadtUniversityUniversity of ArkansasJun 18, 2026arXiv:2606.20246This study reveals that Vision-Language-Action (VLA) models, despite their complex architectures, contain significant layer-wise representational redundancy, allowing for substantial model compression. By employing a training-free structural compression pipeline that utilizes Centered Kernel Alignment, the authors demonstrate that it is possible to reduce model depth by up to 50% without sacrificing performance. The streamlined architecture not only accelerates downstream fine-tuning by 40-50% but also enhances real-time inference speed by up to 30%, validating its effectiveness across multiple benchmarks and real-world tasks.
Advanced Vision-Language-Action models can be dramatically compressed by up to 50% without losing performance, reshaping our approach to robotic manipulation.
Vision-Language-Action (VLA) models pre-trained on massive video-robot datasets have revolutionized robotic manipulation, yet their multi-billion parameter architectures impose prohibitive computational burdens during downstream fine-tuning and real-time inference. In this work, we reveal a highly non-trivial architectural characteristic of these continuous control foundation policies (e.g., pi_0, GR00T-N1.5): despite being trained on diverse physical trajectories, they exhibit severe layer-wise representational redundancy. To exploit this, we introduce a structural compression pipeline that is entirely training-free, bypassing the need of existing methods to load full-scale models to learn optimized token reductions or dynamic layer selectors. Instead, using only a single forward pass via Centered Kernel Alignment to identify redundant layer features, we remove twin layers to permanently compress the model depth by up to 50% across both the VLM backbone and the continuous control policy head. Downstream fine-tuning of this streamlined architecture yields a dual acceleration benefit: a 40-50% reduction in training time and up to 30% faster real-time inference, while matching or exceeding full-scale base model performance. We comprehensively validate our method across three simulation benchmarks (LIBERO, RoboCasa, SimplerEnv) and 10 diverse real-world manipulation tasks across 4 unique robotic embodiments. These results prove that advanced VLAs require significantly fewer layers than previously assumed, offering a highly compute-efficient paradigm for scalable robot learning.
