Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
BrickBench is a new benchmark for evaluating agentic text-conditioned LEGO-set design, requiring agents to produce physically buildable assemblies that satisfy semantic and design criteria by reasoning over discrete part selection and local/global constraints. The benchmark includes BrickAgent, an environment for agent development and validation, and is scored on validity, alignment, and design quality across varying scales and part availabilities. While current leading agents largely meet verifiable physical and semantic requirements, their designs fall short of human-level quality.
LEGO-building AI agents can assemble physically valid structures from text prompts, but their designs lag significantly behind human creativity and complexity.
We propose BrickBench, a benchmark for agentic text-conditioned LEGO-set design. Given a prompt, an agent is tasked with producing an assembly that not only satisfies semantic and design criteria, but that can also be physically built. To do so, it must select parts from a discrete library and reason jointly about local and global constraints. We score validity, alignment, and design across three settings that vary in scale and part availability. We provide BrickAgent, an environment for coding agents to construct, inspect, and validate their designs. We find that leading agents largely satisfy verifiable physical and semantic requirements, but fall short of human designs. We release our benchmark and environment at http://www.brickben.ch