Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
MultiGO++ is a novel framework for monocular 3D clothed human reconstruction that addresses limitations in existing methods related to texture quality, geometric accuracy, and biased single-modality supervision. The framework introduces a multi-source texture synthesis strategy using 15,000+ 3D textured human scans, a region-aware shape extraction module with a Fourier geometry encoder, and a dual reconstruction U-Net for geometry-texture collaboration. Experiments demonstrate that MultiGO++ outperforms state-of-the-art methods on benchmark datasets and in-the-wild cases, yielding higher-fidelity textured 3D human meshes.
Achieve more realistic 3D human avatars from single images by jointly optimizing geometry and texture, even when training data is scarce.
Monocular 3D clothed human reconstruction aims to generate a complete and realistic textured 3D avatar from a single image. Existing methods are commonly trained under multi-view supervision with annotated geometric priors, and during inference, these priors are estimated by the pre-trained network from the monocular input. These methods are constrained by three key limitations: texturally by unavailability of training data, geometrically by inaccurate external priors, and systematically by biased single-modality supervision, all leading to suboptimal reconstruction. To address these issues, we propose a novel reconstruction framework, named MultiGO++, which achieves effective systematic geometry-texture collaboration. It consists of three core parts: (1) A multi-source texture synthesis strategy that constructs 15,000+ 3D textured human scans to improve the performance on texture quality estimation in challenge scenarios; (2) A region-aware shape extraction module that extracts and interacts features of each body region to obtain geometry information and a Fourier geometry encoder that mitigates the modality gap to achieve effective geometry learning; (3) A dual reconstruction U-Net that leverages geometry-texture collaborative features to refine and generate high-fidelity textured 3D human meshes. Extensive experiments on two benchmarks and many in-the-wild cases show the superiority of our method over state-of-the-art approaches.