Search papers, labs, and topics across Lattice.
ObjectMorpher introduces a framework for 3D-aware image editing by lifting 2D image instances into editable 3D Gaussian Splatting (3DGS) representations using an image-to-3D generator. It enables users to manipulate objects via control point dragging, employing graph-based non-rigid deformation with ARAP constraints for realistic shape and pose changes. A composite diffusion module then harmonizes the edits for seamless reintegration, achieving state-of-the-art photorealistic results.
Forget clunky 3D modeling software – ObjectMorpher lets you intuitively reshape objects in images with simple drags, yielding photorealistic results that stomp both 2D and previous 3D-aware methods.
Achieving precise, object-level control in image editing remains challenging: 2D methods lack 3D awareness and often yield ambiguous or implausible results, while existing 3D-aware approaches rely on heavy optimization or incomplete monocular reconstructions. We present ObjectMorpher, a unified, interactive framework that converts ambiguous 2D edits into geometry-grounded operations. ObjectMorpher lifts target instances with an image-to-3D generator into editable 3D Gaussian Splatting (3DGS), enabling fast, identity-preserving manipulation. Users drag control points; a graph-based non-rigid deformation with as-rigid-as-possible (ARAP) constraints ensures physically sensible shape and pose changes. A composite diffusion module harmonizes lighting, color, and boundaries for seamless reintegration. Across diverse categories, ObjectMorpher delivers fine-grained, photorealistic edits with superior controllability and efficiency, outperforming 2D drag and 3D-aware baselines on KID, LPIPS, SIFID, and user preference.
