Search papers, labs, and topics across Lattice.
This paper introduces a live trace model that effectively manages the growing complexity of long-horizon agents by creating an append-only event ledger that is incrementally integrated into typed run states. Evaluated against deterministic ground truth, the model significantly reduces input token usage and costs for human observers while improving accuracy, demonstrating a 14x to 15x decrease in token consumption and a 5-7x cost reduction compared to traditional methods. For the agents themselves, the model outperforms full-context prompting in sequential-dependency tasks, achieving a success rate of 100% compared to just 27% for traditional methods, highlighting its efficiency and effectiveness in maintaining task-specific statistics.
A live trace model cuts input token usage by up to 15x while boosting accuracy for monitoring long-horizon agents, transforming how we manage complex agent interactions.
A long-horizon agent's trace outgrows both of its consumers: the human observer monitoring the run, and the agent itself, whose bounded context the trace must be folded back into. We present a live trace model, an append-only event ledger folded incrementally into typed run state and compiled into per-consumer views, and evaluate it for both consumers against deterministic ground truth. For the observer side, evaluated with an LLM reader as proxy, the compiled view answers monitoring questions using approximately 14x and 15x fewer input tokens (by reader) and at 5-7x lower cost than a budget-capped single-call reading of the raw trace, with higher accuracy (0.85-0.87 versus 0.48). Because the questions were co-designed with the view schema, we treat the token and cost reduction, conditional on schema coverage, as the transferable result. For the agent, on 120-link sequential-dependency tasks, mechanisms that maintain the task's running statistic in per-step state succeed where full-context prompting fails (30/30 versus 8/30 under a clean protocol, n=30, labeled descriptive owing to benchmark-system co-development); a prompt-level scratchpad matches the fold's accuracy at lower cost, and a two-arm decomposition attributes the fold's accuracy to its deterministic aggregate and its cost advantage to its compactness. The fold's remaining value over cheaper alternatives is deterministic auditability and serving the observer from the same state. We derive eleven candidate requirements for trace folding from observed failures and delimit them with an order-sensitive task family on which the fold ceases to help. Code, benchmarks, a regenerable synthetic corpus, and all workbench traces are released.
