Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors developed Agent ATO (Agentic Trajectory Observer), a diagnostic visualization tool that reconstructs and categorizes AI coding agent workflows directly from unstructured console logs. As autonomous agents scale in complexity, analyzing failure modes and resource overhead through raw logs or final code diffs alone has become a severe bottleneck for developer oversight. Illustrated across program repair benchmarks, the system decomposes multi-step trajectories into dedicated, contextual timelines for file discovery, reading, editing, and command execution alongside token consumption.
Final code diffs conceal catastrophic agent reasoning: mapping dense execution logs into classified, chronological action streams reveals precisely where models derail or burn tokens during repository navigation.
AI coding agents are becoming part of developers'workflows, but their behavior is difficult to understand from final code changes alone. During a task, agents interact with software repositories through sequences of actions such as searching for files, reading code, editing programs, and running tests or build commands. These interactions, together with token usage, are often recorded in console logs, but raw logs are difficult for developers to inspect. In this paper, we propose Agent ATO (Agentic Trajectory Observer), a tool for visualizing AI coding agent interaction timelines from console logs. Agent ATO extracts agent interactions, classifies them by command or tool type, and visualizes them as timelines. In addition to an all-interaction timeline, Agent ATO provides filtered timelines that emphasize file discovery, file reading, file editing, and execution while preserving surrounding context. We illustrate how Agent ATO may help developers inspect and compare agent actions using selected runs from two repair tasks. Future work will apply Agent ATO to more agents, tasks, and development environments, and will evaluate whether it reduces the effort needed to compare trajectories.