Search papers, labs, and topics across Lattice.
Ink3D addresses the challenge of generating intricate textures for 3D assets by leveraging large-scale video generative models. The framework first reconstructs a basic geometry using a standard 3D generation model and then employs OrbitPainter to create dense orbit-scan videos that capture the object's appearance from multiple viewpoints. By integrating these observations with the TextureOptimizer, Ink3D achieves a notable improvement in texture fidelity and complexity compared to existing methods, effectively bridging the gap between 3D geometry and high-quality texture synthesis.
Ink3D achieves a breakthrough in 3D asset creation, enabling the generation of complex textures that were previously unattainable with conventional methods.
Recent 3D generative models can synthesize high-quality geometry but often struggle to reproduce intricate textures from reference images, largely due to the scarcity of large-scale 3D training data with rich surface appearance. In contrast, visual generative models are trained on datasets several orders of magnitude larger and excel at modeling complex visual patterns. Motivated by this gap, we introduce Ink3D, a framework that bridges 3D generation with large-scale video generative models to synthesize extremely complex textures. Ink3D first reconstructs a white-mesh geometry using an off-the-shelf 3D generation model. It then employs OrbitPainter, a conditional video generative model, to produce dense orbit-scan videos capturing object appearance across viewpoints. To convert these views into coherent textures, we introduce TextureOptimizer, a neural baking module that integrates dense multi-view observations while mitigating geometry inconsistencies arising from video generation. By decoupling geometry and texture synthesis and leveraging large-scale pretrained video priors, Ink3D enables significantly richer and more faithful texture generation than prior approaches.
Microsoft Research