Search papers, labs, and topics across Lattice.
This paper introduces EcoVLA, an adaptive device-edge co-inference framework designed for Vision-Language-Action (VLA) models that addresses the dual challenges of real-time control and energy efficiency in robotic systems. By establishing a unified stage-level abstraction and formulating a joint latency and energy prediction model, EcoVLA enables rapid evaluation and selection of optimal co-inference schemes that adapt to runtime variations. Experimental results demonstrate that EcoVLA achieves up to 236% improvement in energy efficiency compared to existing methods while maintaining service level objectives under dynamic conditions.
EcoVLA boosts energy efficiency for VLA models by up to 236% while ensuring real-time performance, revolutionizing how robotic systems manage inference costs.
Vision-Language-Action (VLA) models have emerged as a promising foundation for Embodied AI, but their high inference cost poses significant challenges for deployment in robotic systems. In practice, on-device inference is constrained by limited compute capacity and energy budgets, struggling to simultaneously satisfy real-time control and energy efficiency requirements. Alternatively, offloading the inference workload to an edge server is susceptible to fluctuations in system conditions, introducing unpredictable latency risks. Device-edge co-inference offers a promising solution, but systematic research tailored to VLA models remains scarce, particularly a unified co-inference framework that jointly addresses real-time constraints and system-level energy efficiency. Thus, we propose EcoVLA, an adaptive device-edge co-inference framework for VLA models that maximizes system energy efficiency under real-time constraints. EcoVLA first introduces a unified stage-level abstraction over different VLA paradigms, establishing an architecture-agnostic co-inference design space. It then formulates a joint device-edge-network latency and energy prediction model to enable rapid runtime evaluation of candidate co-inference schemes. Building on this, EcoVLA continuously selects the energy-optimal scheme satisfying real-time constraints with millisecond-level overhead, adapting to runtime variations in network and system states. Furthermore, EcoVLA incorporates a lightweight transmission mechanism for inter-stage intermediate tensors to reduce the communication overhead incurred by cross-device collaboration. Experimental results across VLA models show that EcoVLA improves system energy efficiency by up to 236% over existing co-inference approaches under a 20 Hz action output frequency constraint, while consistently maintaining SLO satisfaction under dynamic network and edge workload conditions.
