Search papers, labs, and topics across Lattice.
ExMesh++ introduces a two-stage framework for reconstructing relightable UV-PBR mesh assets from multi-view images, addressing the challenges of topology, UV parameterization, and material mapping. The first stage refines mesh geometry and topology through adaptive vertex manipulation, while the second stage optimizes UV-space PBR maps alongside environment lighting. Experimental results show that ExMesh++ achieves competitive geometry accuracy and strong relighting performance, facilitating the direct use of the generated assets in standard digital content creation workflows.
Achieving relightable UV-PBR mesh assets from multi-view images could revolutionize the way digital content is created and manipulated.
Multi-view reconstruction extends beyond surface recovery to editable and relightable mesh assets. Such assets require well-formed topology, valid UV parameterization, and explicit PBR material maps. Existing surface reconstruction approaches optimize implicit fields, Gaussian primitives, or other intermediate representations. Converting them into such assets often requires surface extraction and texture baking. Inverse-rendering methods estimate materials and illumination, yet these components often remain tied to neural fields or point-based primitives rather than the final mesh. Joint optimization of geometry, materials, and lighting may also allow these variables to compensate for one another, leading to ambiguous decomposition. To address these limitations, we present ExMesh++, a staged framework for reconstructing relightable UV-PBR mesh assets from multi-view images. The first stage refines explicit mesh geometry and topology through adaptive vertex splitting and merging, while maintaining UV consistency as the topology changes. The second stage fixes the resulting mesh-UV carrier and optimizes UV-space PBR maps together with environment lighting. Building on this stable carrier, ExMesh++ models one-bounce diffuse indirect illumination through secondary-ray tracing with shared UV-PBR materials. Experiments demonstrate competitive geometry accuracy, strong relighting performance, and direct usability of the exported assets in standard DCC workflows.
