Search papers, labs, and topics across Lattice.
This paper introduces MICON-Bench, a new benchmark designed to evaluate the multi-image context generation capabilities of Unified Multimodal Models (UMMs) across six tasks including cross-image composition, contextual reasoning, and identity preservation. To address the limitations of existing benchmarks, the authors also propose an MLLM-driven Evaluation-by-Checkpoint framework for automatic verification of semantic and visual consistency. Furthermore, they present Dynamic Attention Rebalancing (DAR), a training-free inference-time method that dynamically adjusts attention to improve coherence and reduce hallucinations in generated images.
Existing multimodal models struggle with multi-image reasoning, but a new benchmark and inference-time attention fix exposes and alleviates these shortcomings.
Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related images, existing benchmarks rarely address the challenges of multi-image context generation, focusing mainly on text-to-image or single-image editing tasks. In this work, we introduce \textbf{MICON-Bench}, a comprehensive benchmark covering six tasks that evaluate cross-image composition, contextual reasoning, and identity preservation. We further propose an MLLM-driven Evaluation-by-Checkpoint framework for automatic verification of semantic and visual consistency, where multimodal large language model (MLLM) serves as a verifier. Additionally, we present \textbf{Dynamic Attention Rebalancing (DAR)}, a training-free, plug-and-play mechanism that dynamically adjusts attention during inference to enhance coherence and reduce hallucinations. Extensive experiments on various state-of-the-art open-source models demonstrate both the rigor of MICON-Bench in exposing multi-image reasoning challenges and the efficacy of DAR in improving generation quality and cross-image coherence. Github: https://github.com/Angusliuuu/MICON-Bench.
