Search papers, labs, and topics across Lattice.
This paper investigates the parameter redundancy in Vision-Language-Action (VLA) models by analyzing the effects of parameter pruning during VLM-to-VLA adaptation. The authors quantify the spatial distribution of parameter divergence and demonstrate that not all parameters are equally redundant, leading to a new multi-module joint pruning scheme that significantly reduces model size while preserving performance. Their approach achieves a 12%-30% reduction in parameters for OpenVLA and $蟺_{0.5}$, maintaining around 90% of original performance without requiring fine-tuning, contrasting sharply with traditional pruning methods that lead to performance collapse.
Pruning VLA models can reduce parameters by up to 30% while retaining 90% of performance, challenging the notion of parameter redundancy in these complex systems.
Vision-Language-Action (VLA) models have made significant strides in embodied intelligence by integrating the powerful representations of pre-trained Vision-Language Models (VLMs). However, the massive parameter scale of VLAs imposes a heavy computational burden, and these models exhibit extreme sensitivity to parameter pruning. Current paradigms often treat the resulting performance degradation as inevitable, relying on fine-tuning or low-rank corrections to recover efficacy. We challenge this convention by questioning whether the removed parameters are truly redundant if VLA pruning necessitates performance recovery to be effective, or if this paradigm masks the indiscriminate pruning of critical parameters. We revisit parameter redundancy through the lens of VLM-to-VLA adaptation, first quantifying the spatial distribution of parameter divergence during adaptation to reveal structured patterns across different modules. Subsequently, we introduce controlled pruning as a diagnostic probe: by comparing the direct impact of removing different parameter subsets on VLA performance without any fine-tuning, we establish a causal link between adaptation-induced divergence signals and functional contributions. Based on the discovered modular heterogeneities, we design a multi-module joint pruning scheme. Evaluations on the LIBERO benchmark demonstrate that our approach reduces the parameters of OpenVLA and $蟺_{0.5}$ by 12\%--30\% while maintaining approximately 90\% of the original performance without any post-pruning recovery. In contrast, existing parameter pruning criteria result in total performance collapse when evaluated under the same recovery-free constraints. Our study reveals the parameter evolution mechanism in VLA adaptation and provides a new path for deploying efficient, robust robotic policies in resource-constrained environments.
