Search papers, labs, and topics across Lattice.
FlexiAvatar introduces a novel framework for reconstructing animatable 3D human avatars from monocular video by optimizing only the visible body regions, which significantly enhances fidelity in the rendered output. This approach combines occlusion-robust SMPL-X tracking with part-specific residual refinement and employs a diffusion-based method to generate textures for unseen areas, effectively addressing common artifacts in existing models. Experimental results demonstrate that FlexiAvatar achieves an average PSNR improvement of approximately 3% over state-of-the-art methods across various datasets, while also reducing runtime and memory overhead in scenarios with partial visibility.
By focusing optimization solely on visible body regions, FlexiAvatar eliminates artifacts from unobserved limbs, achieving superior reconstruction quality and efficiency.
Reconstructing animatable 3D human avatars from monocular video is a fundamental problem in computer vision with broad applications in AR/VR and digital content creation. Existing approaches typically couple parametric body models with neural rendering or 3D Gaussian splatting and optimize all body regions jointly from short videos, which often degrades fidelity in the visible areas. To overcome this limitation, we introduce FlexiAvatar, a unified framework that explicitly optimizes only the visible body regions, effectively eliminating artifacts arising from unobserved limbs. Our method integrates occlusion-robust SMPL-X tracking with part-specific residual refinement to capture high-frequency geometric and appearance details. To complete entirely unseen regions (e.g., back views), we leverage a diffusion-based approach to generate texture consistent with the observed appearance. Experiments on full-body (NeuMan, ZJU-MoCap, WildAvatar), upper/half-body (talk-show clips), and head-only (INSTA) inputs show that FlexiAvatar delivers consistently higher reconstruction quality, outperforming state-of-the-art methods by an average PSNR improvement of approximately 3% across datasets. Finally, by restricting optimization to observed regions, our method reduces the effective number of Gaussians that must be optimized and rendered, leading to reduced runtime and memory overhead in partial-visibility scenarios.
