Search papers, labs, and topics across Lattice.
CEI-3D is introduced as an editing-oriented 3D reconstruction pipeline that uses a collaborative explicit-implicit representation, combining an implicit SDF network for global structure with explicit handler points for localized control. A physical properties disentangling module decouples handler point color into separate physical properties, using a dual-diffuse-albedo network to prevent editing interference. A spatial-aware editing module then enables part-wise adjustment of handler points using cross-view propagation-based 3D segmentation, leading to more realistic and fine-grained editing results compared to SOTA methods.
Achieve more realistic and fine-grained 3D object editing by combining implicit SDF networks with explicit, locally controllable handler points.
Existing 3D editing methods often produce unrealistic and unrefined results due to the deeply integrated nature of their reconstruction networks. To address the challenge, this paper introduces CEI-3D, an editing-oriented reconstruction pipeline designed to facilitate realistic and fine-grained editing. Specifically, we propose a collaborative explicit-implicit reconstruction approach, which represents the target object using an implicit SDF network and a differentially sampled, locally controllable set of handler points. The implicit network provides a smooth and continuous geometry prior, while the explicit handler points offer localized control, enabling mutual guidance between the global 3D structure and user-specified local editing regions. To independently control each attribute of the handler points, we design a physical properties disentangling module to decouple the color of the handler points into separate physical properties. We also propose a dual-diffuse-albedo network in this module to process the edited and non-edited regions through separate branches, thereby preventing undesired interference from editing operations. Building on the reconstructed collaborative explicit-implicit representation with disentangled properties, we introduce a spatial-aware editing module that enables part-wise adjustment of relevant handler points. This module employs a cross-view propagation-based 3D segmentation strategy, which helps users to edit the specified physical attributes of a target part efficiently. Extensive experiments on both real and synthetic datasets demonstrate that our approach achieves more realistic and fine-grained editing results than the state-of-the-art (SOTA) methods while requiring less editing time. Our code is available on https://github.com/shiyue001/CEI-3D.
