Search papers, labs, and topics across Lattice.
AnoleVLA is introduced as a lightweight Vision-Language-Action model for language-guided robotic manipulation, addressing the computational cost limitations of transformer-based VLAs in resource-constrained environments. The model employs a deep state space model to efficiently process multimodal sequences of visual and textual inputs for trajectory generation. Empirical evaluations demonstrate that AnoleVLA outperforms a large-scale VLA by 21% in task success rate in real-world settings, while also achieving a 3x speedup in inference.
A lightweight VLA with deep state space models lets robots outperform larger models at language-guided manipulation while running 3x faster.
In this study, we address the problem of language-guided robotic manipulation, where a robot is required to manipulate a wide range of objects based on visual observations and natural language instructions. This task is essential for service robots that operate in human environments, and requires safety, efficiency, and task-level generality. Although Vision-Language-Action models (VLAs) have demonstrated strong performance for this task, their deployment in resource-constrained environments remains challenging because of the computational cost of standard transformer backbones. To overcome this limitation, we propose AnoleVLA, a lightweight VLA that uses a deep state space model to process multimodal sequences efficiently. The model leverages its lightweight and fast sequential state modeling to process visual and textual inputs, which allows the robot to generate trajectories efficiently. We evaluated the proposed method in both simulation and physical experiments. Notably, in real-world evaluations, AnoleVLA outperformed a representative large-scale VLA by 21 points for the task success rate while achieving an inference speed approximately three times faster.
