Search papers, labs, and topics across Lattice.
This paper explores a verifier-free approach to selecting the best candidate from multiple parametric CAD programs generated by large language models, addressing the challenge of identifying correct outputs without a ground-truth model. By employing a method called 3D CAD consensus selection, the authors compile multiple candidates into 3D models and select the one that exhibits the highest agreement with the rest of the pool, thus eliminating the need for an external verifier. The results show that geometric consensus selection significantly enhances geometric accuracy, outperforming existing verifier-based methods and random selection across various tested models and prompts.
Verifier-free consensus selection can boost CAD generation accuracy by up to 10% without the need for additional verification systems.
Large language models can write parametric CAD programs from a natural-language description (text-to-CAD generation), but a single sample is often wrong. Increasing test-time compute by sampling multiple candidates only helps if a good candidate can be identified, yet no ground-truth model is available at generation time. Existing systems often require a separate verifier, such as a vision-language judge, to select among candidates. We investigate whether the candidate pool itself provides enough signal for effective selection and a verifier-free alternative. We introduce 3D CAD consensus selection, hereafter consensus selection: sample $N$ parametric CAD programs, compile them to 3D models, and return the candidate that agrees most with the rest of the pool. The method is training-free and compatible with existing CAD agents. We investigate geometric and topological notions of agreement, each of which improves its corresponding evaluation metric. On the exact candidate pools of a state-of-the-art CAD generation method, geometric consensus improves all three geometric metrics over the method's verifier, while topological consensus matches it on topology. Across every tested LLM and prompt variant, geometric consensus also improves geometric accuracy over random selection from the same pool, reducing Chamfer distance by $1-10\%$.
