Search papers, labs, and topics across Lattice.
The paper introduces OmniView-Space, a novel framework that enhances spatial reasoning in Multimodal Large Language Models (MLLMs) by integrating multi-perspective spatial mapping with egocentric reasoning. This approach addresses the limitations of existing methods that struggle with multi-step reasoning by dynamically re-anchoring evidence to specific reference frames. Experiments demonstrate that OmniView-Space achieves state-of-the-art performance on spatial reasoning benchmarks while minimizing dependence on external geometry pipelines.
OmniView-Space redefines spatial reasoning in MLLMs, achieving unprecedented accuracy by leveraging dynamic, egocentric evidence mapping.
Spatial intelligence remains a persistent challenge for Multimodal Large Language Models (MLLMs), as it requires coherent spatial scene representations beyond basic object recognition. Existing methods typically build such representations through textual reasoning or 3D reconstruction. However, they often falter during multi-step reasoning, particularly when required to dynamically re-anchor evidence to the specific camera-, object-, or direction-centric reference frames demanded by complex queries. To address this, we propose OmniView-Space, a framework designed to maintain spatial consistency through multimodal egocentric evidence. Our approach consists of three core components: (1) Multi-Perspective Spatial Mapping (MPSM), which re-anchors reconstructed geometry into a query-aligned visual cognitive map and a textual spatial graph; (2) Tool-Guided Egocentric Reasoning, an interleaved policy trained to actively select the ego anchor required by the query and request the corresponding MPSM evidence; and (3) Cognitive-Map Distillation, which uses MPSM-generated trajectories and ego-frame rewards to train the model to reason with self-generated cognitive maps. Experiments on single- and multi-image spatial reasoning benchmarks show that OmniView-Space achieves state-of-the-art performance. Furthermore, the distilled model maintains this performance while reducing reliance on external geometry pipelines.
