Search papers, labs, and topics across Lattice.
This paper introduces NeuMesh++, a novel mesh-based representation that enhances volumetric editing by disentangling geometry, texture, and semantic codes at the mesh vertices. By implementing techniques such as local space parameterization and spatial-aware optimization, the authors enable a range of editing functionalities, including mesh-guided geometry adjustments and semantic-guided texture modifications. Extensive experiments reveal that NeuMesh++ significantly outperforms existing methods in both representation quality and editing capabilities across various datasets.
Disentangling geometry and texture in neural mesh representations unlocks versatile editing capabilities that traditional methods can't match.
Recently neural implicit rendering techniques have evolved rapidly and demonstrated significant advantages in novel view synthesis and 3D scene reconstruction. However, existing neural rendering methods for editing purposes offer limited functionalities, e.g., rigid transformation and category-specific editing. In this paper, we present a novel mesh-based representation by encoding the neural radiance field with disentangled geometry, texture, and semantic codes on mesh vertices, which empowers a set of efficient and comprehensive editing functionalities, including mesh-guided geometry editing, designated texture editing with texture swapping, filling and painting operations, and semantic-guided editing. To this end, we develop several techniques including a novel local space parameterization to enhance rendering quality and training stability, a learnable modification color on vertex to improve the fidelity of texture editing, a spatial-aware optimization strategy to realize precise texture editing, and a semantic-aided region selection to ease the laborious annotation of implicit field editing. Extensive experiments and editing examples on both real and synthetic datasets demonstrate the superiority of our method on representation quality and editing ability. Project page: https://zju3dv.github.io/neumeshplusplus/
