Search papers, labs, and topics across Lattice.
This paper introduces a novel LLM-driven verification layer designed to enhance robot autonomy by evaluating the permissibility of actions proposed by planning models. The approach addresses critical safety and ethical concerns by preventing biased or unsafe actions from being executed, thus mitigating risks associated with adversarial attacks. The proposed system achieves an impressive 85% precision in categorizing plans and demonstrates 97% effectiveness in containing adversarial threats, with minimal errors in decision-making boundaries.
A verification layer powered by LLMs can filter out unsafe robot actions, achieving 97% containment of adversarial attacks while maintaining high decision-making precision.
Advances in advanced artificial intelligence tools have sparked research in robot autonomy, but the development of such systems has largely focused on execution rather than verifying the feasibility actions planning models propose. Like general-purpose LLMs, robotics planning models carry risks: biased toward user-specified goals, they may suggest actions misaligned with scientific ethics, they may be unsafe due to an inability to"remember"prior safety risks, or they may be vulnerable to adversarial attacks on the autonomy ecosystem. We propose a LLM-driven verification layer between planning and execution to evaluate action permissibility. Our LLM-as-a-Judge ensemble combines chain-of-thought reasoning across models and synthesizes those expert judge outputs, mirroring a combination of a mixture of experts and self-consistency approach. This layer serves as middleware, gating plans from the server's planning module before they reach the MCP server and therefore the robot's low-level controls: plans are approved, rejected for reformulation, or escalated for human review. With this system, we achieve near 85% precision across accept/escalate/reject categories 97% containment of adversarial attacks, with negligible errors between accepting and rejecting tasks, and errors mostly manifesting at the escalate boundary.
