Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces UMI3D, a novel framework that enhances 3D asset generation from unconstrained multi-image inputs by addressing the limitations of existing models in cross-attention routing. By implementing Simultaneous Focus Cross-Attention (SFC-Attn), UMI3D allows each voxel to selectively focus on the most relevant image during the denoising process, effectively resolving issues of distorted geometry and chaotic textures. The method leverages a new Voxel Reference Score (VRS) to determine voxel-image affinities, resulting in significant improvements in multi-image 3D generation tasks without the need for extensive training or additional models.
Unlocking the potential of multi-image 3D generation, UMI3D allows each voxel to focus on its most informative image, leading to unprecedented quality in asset creation.
Recent 3D foundation models can generate high-quality assets from a single image, but degrade markedly on unconstrained multi-image inputs, often producing distorted geometry, over-smoothed textures, and chaotic colors. We argue that this failure stems not from limited model capacity, but from a mismatch between single-image cross-attention and the multi-image setting: existing models lack a principled way to decide which image each 3D voxel should trust at each denoising step. Revisiting recent single-image 3D foundation models, we show that explicitly routing each voxel to its most informative image is sufficient to unlock strong performance on inconsistent multi-image inputs. Based on this observation, we propose UMI3D, a training-free and plug-and-play framework that restructures cross-attention for unconstrained multi-image 3D generation. Its core, Simultaneous Focus Cross-Attention (SFC-Attn), activates all conditioning images at each denoising step while allowing each voxel to focus on the single image that best explains it. To enable this routing, we derive the Voxel Reference Score (VRS), a model-intrinsic metric for voxel--image affinity that requires no external matching, segmentation, or correspondence models. Extensive experiments show that UMI3D unlocks the multi-image potential of single-image 3D generation frameworks across diverse tasks. Project Page: UMI3D-Project.github.io.