Search papers, labs, and topics across Lattice.
OMGTex is introduced, a novel diffusion-based framework for reconstructing high-quality, editable facial UV textures from multi-style images without relying on 3D geometry priors. The framework employs a gradient-guided refinement strategy to correct UV misalignment during inference and a training paradigm that leverages the semantic distribution capabilities of diffusion models for semantic-aware editing. OMGTex achieves state-of-the-art performance on facial texture benchmarks and introduces CANVAS, a new paired dataset for multi-style texture reconstruction.
Ditch the finicky 3D geometry: OMGTex directly maps 2D face images to editable UV textures with a diffusion model, opening the door to robust facial texture reconstruction across diverse styles.
We propose OMGTex, an end-to-end diffusion-based framework for reconstructing high-quality and editable facial UV textures from multi-style facial images. Existing texture reconstruction methods face two major limitations: (1) Fragility due to reliance on 3D geometry priors, which are difficult to estimate accurately, especially under facial occlusions or in stylized domains; and (2) A lack of semantic disentanglement, inhibiting region-specific texture editing and style transfer. Our work addresses both challenges simultaneously. Our core innovation is a geometry-free pipeline that directly maps a 2D face image to its corresponding editable UV texture. We introduce two key techniques: First, to address the challenge of UV misalignment common in diffusion generation, we introduce a gradient-guided refinement strategy at inference time, which explicitly corrects structural consistency. Second, we leverage the inherent semantic distribution capability of diffusion models and design a novel training paradigm to enhance this tendency, enabling semantic-aware editing of facial texture. Furthermore, to address the data scarcity in multi-style texture reconstruction, we construct CANVAS, the first comprehensive paired texture reconstruction dataset covering realistic and diverse stylized domains. To the best of our knowledge, OMGTex is the first geometry-free inference framework that achieves robust, style-consistent, and editable facial texture reconstruction across diverse domains. Our method achieves state-of-the-art performance on multiple facial texture benchmarks.
