Search papers, labs, and topics across Lattice.
SUPRA-Tex addresses single image 3D generation by decoupling material estimation, surface alignment, and 3D completion, enabling better preservation of fine details and fusion of multi-view predictions. It leverages an MLLM to predict lighting-separated PBR maps, which are then projected and encoded into observation latents. An interleaved flow transformer uses these latents as anchors for alternating updates, achieving high fidelity on visible regions and coherent completion of unobserved surfaces.
Achieve "What You See Is What You Get" fidelity in single-image 3D texturing by decoupling material estimation and using observation latents as fixed anchors.
Single image 3D generation aims to dress a given 3D mesh with relightable materials while faithfully preserving the visual details of a reference image. Existing methods either introduce artifacts when fusing inconsistent multi-view predictions or struggle to preserve fine details through implicit image-feature conditioning. To resolve these challenges, we introduce SUPRA-Tex, built on the principle of decoupling visible-material estimation, surface alignment, and observation-guided 3D completion. This division of labor allows the 3D generator, trained on limited 3D data, to focus its capacity on preserving visible evidence and completing unobserved surfaces. Specifically, we first train an MLLM-based image editing model to predict lighting-separated PBR maps in the reference view. We then project these maps onto the visible surface and encode them with the pretrained material VAE encoder into native observation latents that share the generation target's latent space. An interleaved flow transformer holds these latents as fixed, read-only anchors while alternating unobserved-region and full-surface updates to generate complete material latents. This design achieves super-alignment with the reference, delivering What You See Is What You Get fidelity on visible regions and coherent completion on unobserved surfaces. Trained solely on public datasets, SUPRA-Tex achieves SOTA performance in both geometry-conditioned texturing and end-to-end asset generation, matching or even exceeding leading commercial systems on in-the-wild images. Project page: https://supra-3d.github.io/supratex/