Search papers, labs, and topics across Lattice.
TreeSoc introduces a hierarchical search framework for soccer video understanding that reformulates question answering into a structured reasoning process. By employing a dynamic depth-first search mechanism, it decomposes complex queries into sequential sub-tasks, allowing for iterative reasoning refinement and adaptive tool routing. This approach achieves state-of-the-art performance on SoccerBench and demonstrates strong cross-domain generalization, highlighting the effectiveness of structured reasoning in enhancing video understanding capabilities.
TreeSoc achieves an impressive 85.2% accuracy in soccer video question answering by transforming complex queries into manageable sub-tasks through structured reasoning.
Automated understanding of complex soccer scenarios from video remains a significant challenge for contemporary vision-language models (VLMs), which suffer from shallow cross-modal alignment and exhibit fundamental limitations in multi-step reasoning and coordinated tool integration. We present TreeSoc, a structured reasoning framework that reformulates soccer video question answering as a hierarchical search problem rather than a single-pass prediction. Specifically, TreeSoc employs a dynamic depth-first search (DFS) mechanism that decomposes complex queries into sequentially ordered sub-tasks, enabling iterative reasoning refinement through explicit intermediate states. This tree-structured decomposition naturally supports adaptive tool routing, wherein domain-specific modules are selectively activated and their outputs incorporated at each reasoning node to produce contextually grounded predictions. On SoccerBench, TreeSoc achieves state-of-the-art performance, with accuracies of 85.2%, 87.4%, and 82.2% on TextQA, ImageQA, and VideoQA, respectively. Additionally, TreeSoc further demonstrates strong cross-domain generalization, attaining 74.16% accuracy on NExT-QA. These results establish structured, tool-augmented tree reasoning as an effective paradigm for robust video understanding. Code is available at: https://github.com/thanhnhan29/TreeSoc.
