Search papers, labs, and topics across Lattice.
The paper introduces Gaussian Mesh Renderer (GMR), a novel differentiable rendering technique that combines the advantages of 3D Gaussian Splatting (3DGS) and triangle mesh models for efficient and high-fidelity surface reconstruction. GMR analytically derives Gaussian primitives from mesh triangles, enabling efficient rasterization and backpropagation of gradients. The key result is a mesh renderer with smoother gradients, facilitating optimization with smaller batch sizes and reduced memory consumption compared to traditional mesh-based differentiable renderers.
Differentiable mesh rendering just got a whole lot faster and memory-efficient by borrowing tricks from Gaussian Splatting.
3D Gaussian Splatting (3DGS) has enabled high-fidelity virtualization with fast rendering and optimization for novel view synthesis. On the other hand, triangle mesh models still remain a popular choice for surface reconstruction but suffer from slow or heavy optimization in traditional mesh-based differentiable renderers. To address this problem, we propose a new lightweight differentiable mesh renderer leveraging the efficient rasterization process of 3DGS, named Gaussian Mesh Renderer (GMR), which tightly integrates the Gaussian and mesh representations. Each Gaussian primitive is analytically derived from the corresponding mesh triangle, preserving structural fidelity and enabling the gradient flow. Compared to the traditional mesh renderers, our method achieves smoother gradients, which especially contributes to better optimization using smaller batch sizes with limited memory. Our implementation is available in the public GitHub repository at https://github.com/huntorochi/Gaussian-Mesh-Renderer.
