Search papers, labs, and topics across Lattice.
This paper introduces MIRROR, a novel approach that leverages complementary reasoning paths from different views in multimodal reasoning, specifically targeting the weaknesses of vision-language models (VLMs) in visual reasoning tasks. By constructing ODA-Data, a comprehensive dataset with text-dominant, image-dominant, and combined views of geometry problems, the authors demonstrate that VLMs can significantly benefit from a self-supervised reinforcement learning framework that optimizes reasoning across modalities. The key result shows that MIRROR outperforms standard reinforcement learning methods, leading to improved accuracy and consistency in reasoning across various modalities on geometry benchmarks.
Different views of the same problem reveal hidden reasoning paths, enabling VLMs to achieve unprecedented accuracy in multimodal reasoning tasks.
Unlike large language models (LLMs) that exhibit strong reasoning capabilities, vision-language models (VLMs) struggle with visual reasoning, even on geometry problems that admit equivalent text, diagram, and combined diagram+text views. We show that these views often elicit different behaviors: a model may solve a problem from text but fail on the corresponding diagram, or succeed visually while failing textually. This inconsistency suggests that different views expose complementary reasoning paths and failure modes that standard multimodal post-training does not fully exploit. To study and exploit this phenomenon, we construct ODA-Data, a high-quality paired multimodal geometry dataset with text-dominant, image-dominant, and combined image+text views of the same problems, together with splits for training and evaluating modality-dependent reasoning behaviors. We then develop Modality-Informed Reciprocal Reasoning Optimization (MIRROR), a reinforcement learning approach for improving multimodal reasoning via self supervision. For each problem, MIRROR evaluates the model under all views, selects the best-performing view as a teacher, and trains other views with a reverse-KL objective towards the teacher. Across reasoning benchmarks that evaluate on geometry problems, MIRROR improves over standard RL and yields more accurate and consistent behavior across modalities
CMU ML