Search papers, labs, and topics across Lattice.
This paper presents a fully autonomous sports commentary system designed for RoboCup soccer matches, leveraging a neuro-symbolic architecture to convert visual statistics from match videos into coherent, real-time narration. The system effectively bridges the gap between kinematic data and natural language generation, ensuring accurate and engaging commentary without hallucinations. Key results demonstrate its adaptability to various humanoid robot sizes and its capability to operate seamlessly during live streaming and post-game analysis.
Real-time, hallucination-free sports commentary for RoboCup matches could revolutionize how we analyze and engage with robotic soccer.
RoboCup has always been a scenario to develop systems that solve real-world problems. Driven by the main goal of playing against the 2050 FIFA World Cup champions, the RoboCup Soccer leagues need to constantly measure how the research community is progressing. Computing visual statistics from match videos is a crucial way to track this evolution. To address this challenge, this paper introduces a fully autonomous, real-time sports commentator for RoboCup matches. By bridging the gap between raw kinematic tracking and natural language generation, our neuro-symbolic architecture extracts precise statistics from video streams and turns them into fluent, hallucination-free narration. The proposed system is capable of generating statistics and commentary both during live match streaming and in post-game analysis, easily adapting to the new dynamism of the league where different humanoid robots of different sizes share the field. Supplemental materials are available at https://lab-rococo-sapienza.github.io/MARIO/
