Search papers, labs, and topics across Lattice.
This paper introduces GUSH3R, a feed-forward framework that reconstructs dynamic human-scene environments from monocular videos by modeling both static scenes and non-rigid human dynamics in a single forward pass. The method leverages 3D Gaussian Splatting (3DGS) to produce geometrically consistent representations that enable photorealistic rendering and novel view synthesis. Experimental results show that GUSH3R not only matches the quality of existing optimization-based methods but also significantly enhances inference efficiency, addressing a critical limitation in current approaches to dynamic scene reconstruction.
GUSH3R achieves real-time dynamic human-scene reconstruction with photorealistic quality, outperforming traditional optimization methods in efficiency.
Reconstructing dynamic human-scene environments from monocular videos is a challenging problem that requires jointly modeling scene geometry, camera motion, and non-rigid human dynamics while enabling photorealistic rendering. Recent feed-forward methods can efficiently predict geometry, but they are often limited to non-photorealistic representations such as point clouds and meshes, or they fail to handle non-rigid objects, particularly dynamic humans. To fill this gap, we present GUSH3R (Gaussian-Unified Scene Human 3D Reconstruction), a feed-forward framework for online dynamic human-scene reconstruction. From a monocular human-scene video, our method reconstructs dynamic humans (everyone) and static scenes (everywhere) in a single forward pass (all at once) as 3D Gaussian Splatting (3DGS) primitives (as gaussians), which are geometrically consistent and capable of novel view synthesis. Experiments on monocular human-scene datasets demonstrate that our approach achieves competitive novel view synthesis quality while significantly improving inference efficiency compared to optimization-based methods.
