Search papers, labs, and topics across Lattice.
This paper introduces a contract-grounded architecture for synthesizing robot behavior trees (BTs) from natural language, addressing the limitations of existing LLM-based approaches that rely on prompt authors to ensure grounding. By querying a robot-side Model Context Protocol (MCP) server, the proposed method retrieves an explicit contract detailing the robot's skill library and permitted BT operators, allowing non-expert users to issue commands without needing implementation knowledge. Evaluation across 110 simulated tasks and 14 physical tasks demonstrates that this architecture achieves near-perfect BT validation and high task success rates, particularly benefiting from BT composition templates for reactive control-flow tasks.
Contract grounding transforms the synthesis of robot behavior trees, allowing non-experts to command robots with near-perfect execution success.
Synthesizing deployable robot behavior trees (BTs) from natural language (NL) requires grounding to ensure every generated BT references only skills a robot can actually execute. Existing LLM-based BT synthesis approaches often place this grounding responsibility on the prompt author. This makes deployment brittle when the author does not know which skills the robot can execute, how those skills are parameterized, or how the robot runtime software constrains valid BT structure. This paper proposes a contract-grounded BT synthesis architecture in which a coding agent queries a robot-side Model Context Protocol (MCP) server to retrieve an explicit contract consisting of a skill library, permitted BT operators, and optional BT composition templates, before synthesizing a BT for validation and execution. In our framework, non-expert operators issue NL commands without knowledge of robot implementation details, while a robot runtime validation gate enforces correctness before execution. We evaluate two LLMs, a closed model (Sonnet 4.6) and a smaller open-source model (Gemma4:31b), across 110 simulated tasks in PyRoboSim and 14 tasks on a physical Husarion Panther robot. Results show that contract grounding enables near-perfect BT validation and high task success, that BT composition templates substantially recover success on reactive control-flow tasks for the smaller model, and that the architecture transfers to physical hardware running a Nav2 stack opaque to both operator and agent.
