Search papers, labs, and topics across Lattice.
This paper introduces P3D-Bench, a novel benchmark designed to evaluate multimodal large language models (MLLMs) in the context of parametric 3D generation and structural reasoning. The benchmark assesses models on their ability to generate geometrically precise and semantically aligned parametric 3D programs from text and visual specifications, covering three task families: Text-to-3D, Image-to-3D, and Assembly-3D. Evaluation results reveal significant challenges, particularly in the assembly task, where models struggle to compose coherent structures and accurately reproduce specified geometries, highlighting the limitations of current MLLMs in 3D modeling tasks.
MLLMs can recover global shapes but often fail to capture precise parametric geometry, revealing critical gaps in their 3D modeling capabilities.
Multimodal large language models can write code to produce complex programs as well as use programs to do 3D modeling, which opens up a new avenue for 3D generation powered by their priors, world knowledge and reasoning. Yet existing benchmarks rarely evaluate 3D modeling through code. Such modeling demands more than runnable code: from a text or visual specification, a model must generate a parametric 3D program that is geometrically precise, semantically aligned and assembly-consistent. We introduce P3D-Bench, a benchmark for parametric 3D generation. Unlike a 3D mesh, a parametric 3D program exposes explicit dimensions, construction operations and part relations, revealing whether a model recovers a design's structure, not just its appearance. Under a unified protocol, P3D-Bench covers three task families (Text-to-3D, Image-to-3D and Assembly-3D) and scores each output for executability, geometric fidelity, topology, text-grounded constraints, multiview semantic alignment and part-level structure. We evaluate frontier MLLMs and text-only LLMs on 400 text cases, 400 image cases and 203 annotated assemblies, with domain-specific models as reference points. Our extensive evaluation yields three findings. First, assemblies are the hardest setting, where models still fail to compose multiple parts into a coherent structure. Second, models can often recover the global shape and semantic identity of the target object, yet fail to reproduce the precise parametric geometry specified by the input. Third, part-level modeling remains weak on assemblies, where models recover neither the geometry of each part nor the right number of parts. These results position P3D-Bench as a benchmark for evaluating precise parametric geometry and part-level structure in parametric 3D generation.
