Search papers, labs, and topics across Lattice.
UniVR is a novel framework that integrates complex reasoning, physical dynamics, and long-term planning using only visual demonstrations, without relying on task-specific heuristics or image-text pairs. The core of UniVR is the VR-GRPO reinforcement learning paradigm, which utilizes both global and step-level rewards to maintain logical coherence and physical consistency in reasoning tasks. Evaluated on the newly constructed VR-X benchmark, UniVR shows a significant performance boost of up to 25%, highlighting its effectiveness in visual reasoning and its applicability to multimodal understanding tasks.
Achieving a 25% performance improvement in visual reasoning tasks, UniVR reveals the untapped potential of reasoning directly from visual data.
Learning broad world knowledge directly from raw visual data is a fundamental capability of intelligence. We introduce UniVR, the first investigation into simultaneously learning complex reasoning, fine-grained physical dynamics, and long-term planning from pure visual demonstrations. At its core, UniVR features VR-GRPO, a reinforcement learning paradigm with complementary global and step-level rewards. This approach enforces logical coherence and physical consistency throughout the reasoning process without requiring task-specific heuristics or image-text pairs. To train and evaluate UniVR, we construct VR-X, a large-scale benchmark curated from 16 diverse sources spanning long-horizon manipulation, spatial puzzles, and physical reasoning. It is the first comprehensive suite to assess these heterogeneous capabilities under a purely visual protocol. Remarkably, UniVR achieves up to a 25% improvement on VR-X, and its superior visual reasoning also boosts performance on various multimodal understanding benchmarks. These findings underscore the vast potential of reasoning within visual spaces, with all code, data, and models are open-sourced for further research.
