Search papers, labs, and topics across Lattice.
This paper introduces I2C-3D, an optimization-based method for generating multi-view consistent compositional 3D assets that addresses the limitations of existing approaches in modeling Gaussian primitives and cross-view inconsistency. By employing an Inclusive Interactive Collisions strategy, the method ensures that objects interact in a physically plausible manner, while Multi-View Adaptive Score Distillation Sampling enhances consistency across different views. Experimental results show that I2C-3D significantly outperforms current methods in both generation quality and multi-view coherence, enabling more flexible 3D editing and complex scene generation.
I2C-3D achieves unprecedented multi-view consistency in compositional 3D generation, outperforming existing methods and enabling realistic object interactions.
Recent breakthroughs in 3D generation have advanced notably with the development of text-to-image diffusion model. However, existing methods remain two practical challenges: (1) They primarily generate single 3D object, but struggle to generate multi-object compositional 3D assets due to the lack of the modeling for Gaussian primitives in reasonable interactions. (2) They often suffer from cross-view inconsistency during 3D optimization, as Score Distillation Sampling inherently performs on each single view, inevitably resulting in cross-view hallucinations. To solve above issues, we propose I2C-3D, a novel optimization-based method to generate multi-view consistent compositional 3D assets with reasonable interactions. Specifically, we propose an Inclusive Interactive Collisions strategy to guide Gaussian primitives appearing in reasonable interaction regions naturally, thereby ensuring objects in the compositional scene interact in a physically plausible and visually coherent way. Additionally, to enhance multi-view consistency, Multi-View Adaptive Score Distillation Sampling is devised to distill multi-view consistency prior and layout prior from pre-trained diffusion model by modulating attention map of instance token and spatial token across viewpoints. Benefiting from above elaborate designs, I2C-3D not only generates high-fidelity multi-view consistent compositional 3D assets but also supports 3D editing flexibly, facilitating complex scene generation. Extensive experiments demonstrate our I2C-3D outperforms existing methods in generation quality and multi-view consistency.
