Search papers, labs, and topics across Lattice.
This paper introduces MeshWeaver, an autoregressive mesh generation framework that enhances tokenization efficiency and incorporates geometry-aware guidance by treating mesh generation as a surface weaving process. The method utilizes a multi-level sparse-voxel encoder to provide voxel features that inform vertex predictions, allowing for a more coherent and contextually relevant generation of high-poly meshes. Experimental results show that MeshWeaver achieves a remarkable compression ratio of 18% and generates meshes with up to 16K faces, significantly improving geometric fidelity compared to existing methods.
MeshWeaver achieves a groundbreaking 18% compression ratio while generating high-fidelity meshes with over 16K faces by weaving geometry directly into the autoregressive process.
Autoregressive mesh generation has gained attention by tokenizing meshes into sequences and training models in a language-modeling fashion. However, existing approaches suffer from two fundamental limitations: (i) low tokenization efficiency, which yields long token sequences and prevents scaling to high-poly meshes, and (ii) absence of geometry-aware guidance, as generation is conditioned only on global shape embeddings rather than local surface cues. We introduce MeshWeaver, an autoregressive framework that treats mesh generation as a surface weaving process by directly predicting the next vertex instead of independent coordinates. At its core is a multi-level sparse-voxel encoder that injects geometric context into the generative process in three complementary ways: providing voxel features as vertex representations, guiding token prediction via cross-attention to voxel features, and serving as a structural scaffold that constrains generation around the input surface. Our hierarchical design enables coarse-to-fine vertex prediction in a single decoding step, while tightly coupling the generative model with 3D geometry. Extensive experiments demonstrate that MeshWeaver achieves a state-of-the-art compression ratio of 18%, can generate meshes with up to 16K faces, and significantly improves geometric fidelity over prior approaches.
