Search papers, labs, and topics across Lattice.
This study evaluates the effectiveness of a single-agent CAE simulation harness compared to multi-agent specialized systems in generating simulations from natural language requests. The findings reveal that a well-designed single-agent system can outperform multi-agent setups, achieving a success rate of 96.4% on the FoamBench benchmark, primarily due to its execution-feedback repair mechanism and the incorporation of domain knowledge. Notably, scripted reflection did not contribute to performance improvements, highlighting the importance of targeted knowledge integration over generic enhancements.
A single-agent CAE simulation harness can outperform complex multi-agent systems, achieving a 96.4% success rate by leveraging execution feedback and domain knowledge.
Computer-aided engineering (CAE) simulation is among the largest and most demanding areas of engineering, where setting up a solver such as OpenFOAM, FEniCS, or COMSOL takes real expertise. Large language model (LLM) agents promise to turn a natural-language request into a working simulation, and recent CAE agents add simulation-specific machinery: multi-agent decomposition, domain retrieval, and scripted reflection. That machinery suited weak base models; modern harnesses already supply multi-turn reasoning, tool use, and execution feedback. We ask what a CAE simulation agent still needs beyond a generic harness. With information access and repair budget held fixed, a single-agent harness matches or beats multi-agent specialized systems (FoamBench 96.4\% vs.\ 88.2\%). Ablations trace this to capabilities the harness already provides: execution-feedback repair lifts FoamBench from 71.8\% with no repair round to 96.4\%, while scripted reflection adds nothing. The one input that still helps is domain knowledge supplied as solver tutorials, our largest measured gain (80.9\% to 96.4\%).
