Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
TRACE is introduced, a mesh-guided 3D Gaussian Splatting (3DGS) editing framework that enables fine-grained, part-level manipulation of 3D scenes while preserving structural integrity. It uses a novel three-stage approach: Multi-view 3D-Anchor Synthesis with a sparse-view editor trained on the MV-TRACE dataset, Tangible Geometry Anchoring (TGA) for precise spatial synchronization, and Contextual Video Masking (CVM) for temporally stable rendering. Experiments demonstrate TRACE's superior performance in editing versatility and structural integrity compared to existing methods.
Achieve automated, high-fidelity 3D scene transformations with part-level manipulation and structural integrity using a mesh-guided 3DGS editing framework.
We present TRACE, a mesh-guided 3DGS editing framework that achieves automated, high-fidelity scene transformation. By anchoring video diffusion with explicit 3D geometry, TRACE uniquely enables fine-grained, part-level manipulatio--such as local pose shifting or component replacemen--while preserving the structural integrity of the central subject, a capability largely absent in existing editing methods. Our approach comprises three key stages: (1) Multi-view 3D-Anchor Synthesis, which leverages a sparse-view editor trained on our MV-TRACE datase--the first multi-view consistent dataset dedicated to scene-coherent object addition and modificatio--to generate spatially consistent 3D-anchors; (2) Tangible Geometry Anchoring (TGA), which ensures precise spatial synchronization between inserted meshes and the 3DGS scene via two-phase registration; and (3) Contextual Video Masking (CVM), which integrates 3D projections into an autoregressive video pipeline to achieve temporally stable, physically-grounded rendering. Extensive experiments demonstrate that TRACE consistently outperforms existing methods especially in editing versatility and structural integrity.