Search papers, labs, and topics across Lattice.
This paper addresses the critical risks associated with deploying LLM-based agents in organizational settings by emphasizing the importance of analyzing the agents' trajectories鈥攃omprising reasoning steps, tool invocations, and environmental observations. The authors highlight that many potential failures can only be detected through these trajectories and advocate for a systematic approach to agent testing and debugging to ensure safe deployment. Key findings include the identification of challenges such as the oracle problem and the need for formal adequacy metrics, culminating in a practical checklist for deployment readiness and outlining essential open problems for future research.
Many failures in AI agents can only be detected through their reasoning trajectories, revealing a hidden layer of risk in deployment that demands urgent attention.
LLM-based agents are rapidly moving from research prototypes into the core business processes of organizations, but these agents pose deployment risks to security, compliance, and functionality. In this article, we argue that risk-free deployment must be grounded in the agent's trajectory: the recorded sequence of reasoning steps, tool invocations, and environmental observations. Trajectories are available for any agent, and many failures are visible only in the trajectory. To make agents deployable and sustainable, we advocate agent testing and debugging as a systematic research direction for detecting and mitigating these risks. This article begins with the challenges of testing agents, including the oracle problem, non-determinism, trajectory validation, and the absence of adequacy metrics. We then turn to debugging agents, from automated failure attribution to repair and self-evolution. We distill these directions into a practical deployment-readiness checklist covering the full deployment lifecycle. Finally, we identify open problems, i.e., formal adequacy metrics, root-cause attribution over long-horizon trajectories, and the reliability of self-evolving agents, that the community must address to enable trustworthy agent deployment.
