Search papers, labs, and topics across Lattice.
Phi-4-reasoning-vision-15B is a new open-weight multimodal model focused on efficient reasoning, achieved through careful architecture design and data curation. The model excels at scientific and mathematical reasoning, understanding user interfaces, and general vision-language tasks. Key to its performance are systematic data filtering, error correction, synthetic augmentation, and a hybrid data mix with explicit mode tokens for reasoning.
Data quality, not just model size, reigns supreme: Phi-4-reasoning-vision-15B proves that smaller, open-weight multimodal models can achieve competitive performance through rigorous data curation and architecture choices.
We present Phi-4-reasoning-vision-15B, a compact open-weight multimodal reasoning model, and share the motivations, design choices, experiments, and learnings that informed its development. Our goal is to contribute practical insight to the research community on building smaller, efficient multimodal reasoning models and to share the result of these learnings as an open-weight model that is good at common vision and language tasks and excels at scientific and mathematical reasoning and understanding user interfaces. Our contributions include demonstrating that careful architecture choices and rigorous data curation enable smaller, open-weight multimodal models to achieve competitive performance with significantly less training and inference-time compute and tokens. The most substantial improvements come from systematic filtering, error correction, and synthetic augmentation -- reinforcing that data quality remains the primary lever for model performance. Systematic ablations show that high-resolution, dynamic-resolution encoders yield consistent improvements, as accurate perception is a prerequisite for high-quality reasoning. Finally, a hybrid mix of reasoning and non-reasoning data with explicit mode tokens allows a single model to deliver fast direct answers for simpler tasks and chain-of-thought reasoning for complex problems.
