Search papers, labs, and topics across Lattice.
This paper tackles the challenge of quantizing Vision-Language-Action (VLA) models for deployment on resource-constrained robots, identifying temporal error accumulation as a key bottleneck. They introduce Drift-Aware Post-Training Quantization (DA-PTQ), which optimizes quantization by considering trajectory-level motion errors. DA-PTQ uses cross-space representation compensation and motion-driven mixed-precision allocation to minimize kinematic drift, achieving performance comparable to full-precision models at low bit-widths.
Quantizing VLAs for robots doesn't have to trash performance: DA-PTQ recovers near full-precision accuracy even at low bit-widths by explicitly minimizing kinematic drift during sequential control.
Vision-Language-Action models (VLAs) have demonstrated strong potential for embodied AI, yet their deployment on resource-limited robots remains challenging due to high memory and computational demands. While Post-Training Quantization (PTQ) provides an efficient solution, directly applying PTQ to VLAs often results in severe performance degradation during sequential control. We identify temporal error accumulation as a key factor, where quantization perturbations at the vision-language-to-action interface are progressively amplified, leading to kinematic drift in executed trajectories. To address this issue, we propose Drift-Aware Post-Training Quantization (DA-PTQ), which formulates quantization as a drift-aware optimization problem over sequential decision processes. DA-PTQ consists of two components: (1) Cross-Space Representation Compensation, which mitigates structured distortions between multimodal representations and action space to improve action consistency, and (2) Motion-Driven Mixed-Precision Allocation, which assigns bit-widths by minimizing trajectory-level motion errors. Extensive experiments show that DA-PTQ significantly reduces kinematic drift and achieves comparable performance to full-precision models under low-bit settings, enabling practical deployment of VLAs on resource-limited robotic platforms.
