Search papers, labs, and topics across Lattice.
This paper introduces SCOUT, a novel framework that enhances spatial reasoning in Vision-Language Models (VLMs) by integrating a structured Chain-of-Thought (CoT) approach with multi-objective reinforcement learning (RL) techniques. By explicitly modeling 3D environmental perception and employing a tailored advantage estimation method, SCOUT addresses the challenges of credit assignment in complex reasoning tasks. The results show that SCOUT-3B outperforms baseline models by 16.85% on general spatial benchmarks and SCOUT-7B surpasses GPT-4o by 4.28%, demonstrating significant advancements in spatial reasoning capabilities.
SCOUT achieves a remarkable 16.85% improvement in spatial reasoning benchmarks, setting a new standard for Vision-Language Models.
Existing Vision-Language Models (VLMs) exhibits a critical bottleneck in robust spatial reasoning. Recent reinforcement learning (RL) methods aim to close this gap with verifiable outcomes, yet they suffer from poor credit assignment across intermediate reasoning steps. Concurrently, structured reasoning approaches overlook the critical depth perception necessary for comprehensive 3D understanding. To address these challenges, we propose SCOUT (Structured Chain-Of-Thought Utilizing Process-Supervised RL Training). Specifically, we design a structured Chain-of-Thought (CoT) framework that explicitly models 3D environmental perception to ensure robust spatial understanding and reasoning. Furthermore, we introduce a novel RL algorithm featuring multi-objective process rewards and a tailored advantage estimation method, facilitating fine-grained credit assignment across distinct segments of the reasoning trajectory. To support our framework, we develop SCOUT-24k, a structured spatial reasoning CoT dataset synthesized through a customized pipeline. Extensive evaluations demonstrate that SCOUT-3B improves upon baseline models by 16.85% and 6.3% on general spatial benchmarks and complex spatial reasoning tasks respectively. Notably, our larger SCOUT-7B even outperforms GPT-4o by a margin of 4.28%. Moreover, despite being trained exclusively on single image, SCOUT-7B exhibits robust out-of-domain generalization to multi-image and video scenarios. These empirical results render SCOUT as a critical step towards next generation of spatially-aware VLMs.
Tsinghua AI