Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a ROS 2 wrapper for the Florence-2 vision-language model, enabling its integration into robotic systems via topic-driven processing, service calls, and asynchronous actions. The wrapper facilitates local execution of Florence-2, supporting both native installation and Docker deployment, and provides both generic JSON and standard ROS 2 message outputs. Performance evaluations on various GPUs demonstrate the feasibility of local deployment using consumer-grade hardware, bridging the gap between advanced vision-language models and practical robotic applications.
Integrating Florence-2 with ROS 2 unlocks richer semantic perception for robots, moving beyond task-specific pipelines.
Foundation vision-language models are becoming increasingly relevant to robotics because they can provide richer semantic perception than narrow task-specific pipelines. However, their practical adoption in robot software stacks still depends on reproducible middleware integrations rather than on model quality alone. Florence-2 is especially attractive in this regard because it unifies captioning, optical character recognition, open-vocabulary detection, grounding and related vision-language tasks within a comparatively manageable model size. This article presents a ROS 2 wrapper for Florence-2 that exposes the model through three complementary interaction modes: continuous topic-driven processing, synchronous service calls and asynchronous actions. The wrapper is designed for local execution and supports both native installation and Docker container deployment. It also combines generic JSON outputs with standard ROS 2 message bindings for detection-oriented tasks. A functional validation is reported together with a throughput study on several GPUs, showing that local deployment is feasible with consumer grade hardware. The repository is publicly available here: https://github.com/JEDominguezVidal/florence2_ros2_wrapper