Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces CADEngBench, a two-track benchmark designed to rigorously evaluate the engineering capabilities of CAD models beyond mere visual correctness. It assesses 300 parametric parts and 150 body pairs through a series of tasks that include boundary-representation validity, functional editing, and kinematic verification, revealing that while editing existing CAD is easier than generating new designs, challenges remain in complex edits and assembly predictions. The findings emphasize the necessity of evaluating CAD models based on their engineering behavior and functional performance rather than their appearance alone.
Editing CAD models is significantly easier than generating them from scratch, but complex edits and assembly predictions still pose substantial challenges.
A CAD model is not engineering-grade merely because it looks correct. It must satisfy design requirements, respond predictably to parameter changes, support controlled edits, match a reference structural response under a declared analysis, and connect to other parts through valid joints. We present CADEngBench, a two-track benchmark for these capabilities. CADEngBench-P evaluates 300 parametric parts, each used for one zero-to-CAD task and one functional-editing task (600 tasks in total), through boundary-representation (B-Rep) validity, engineering and DFM checks, parameter-family perturbations, functional editing, and matched linear-static FEA in CalculiX. CADEngBench-A evaluates 150 body pairs through ranked joint retrieval, exact face-and-edge grounding, joint-frame prediction, and kinematic verification. Across eight multimodal, code-capable models, editing supplied CAD is substantially easier than generating it, while complex edits and matched FEA remain difficult. Assembly predictions often locate the relevant region but fail to recover the recorded joint or mating entities. These results show that CAD evaluation must test engineering behavior rather than appearance alone.