Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces ROS2SmolVLA, an adaptation of Hugging Face's SmolVLA for lightweight industrial robots, addressing the need for flexible automation in dynamic production environments. By enabling Vision-Language-Action models to operate on Universal Robots' UR10e, the authors tackle the limitations of large models that are impractical for on-premise use. The results demonstrate that SmolVLA effectively performs small-scale tasks, such as pick-and-place operations, validating its applicability in real-world industrial settings.
SmolVLA can seamlessly empower lightweight robots to adapt to dynamic production tasks without the computational overhead of larger models.
Industrial demand changes the paradigms of production. Due to smaller batch sizes and more variations in products, companies face a growing challenge to adopt more adaptive production systems. In particular, robot-based automation is usually static and fails to respond to constantly changing processes. Vision-Language-Action (VLA) Models are a promising opportunity to mitigate this challenge by generating robot actions based on the observed system state. However, current research either focuses on large models that cannot be computed on premise, creating compliance and security challenges, or use lab-grade robot hardware that obscures exploitation in real industrial settings. In this work, we adapt Hugging Face's SmolVLA for Universal Robots lightweight robots. Further, we release the open-source repository ROS2SmolVLA that implements an interface for ROS 2 to SmolVLA, and makes it applicable for industrial-grade hardware. By this, we allow a lenient adoption into lab and industrial environments. We validate the functionality of SmolVLA for a Universal Robots UR10e using a pick-and-place task and give implementation guidelines. Our findings support that SmolVLA is a well-suited option for small-sized tasks that need to be computed on premise.