Search papers, labs, and topics across Lattice.
This paper introduces LemonHarness, an integrated execution framework designed to enhance the performance of large language model (LLM) agents in long-horizon tasks by establishing explicit workspace boundaries for state-changing operations. By constraining file writes, dependency installations, and temporary artifact creations within a controlled environment and providing structured tool interfaces, LemonHarness improves the tracking of state changes and execution feedback. The framework's implementation led to significant accuracy improvements on Terminal-Bench 2.0, achieving 86.52% with the GPT-5.5 model, indicating that a unified runtime boundary and time-aware execution can stabilize agent performance over extended tasks.
A unified runtime boundary and time-aware execution can boost LLM agent accuracy by over 2% in long-horizon tasks, revealing a critical leverage point for enhancing agent stability.
As large language model (LLM) agents are applied to longer tasks, they increasingly modify workspace state across multiple rounds of iteration. However, agents typically observe only tool outputs and log fragments, while the actual state changes occur in the file system. Without explicit workspace boundaries, state-changing operations such as file writes and temporary artifact generation may scatter changes across paths. Over time, these weakly constrained changes accumulate, making states such as modified files difficult to track. This paper presents LemonHarness, an integrated execution framework for long-horizon agents. LemonHarness establishes an explicit execution boundary by constraining state-changing operations within a clearly defined workspace and bringing model invocation, tool execution, and rule knowledge within a single controlled boundary. State-changing operations, including file writes, dependency installation, and temporary artifact creation, are executed through structured tool interfaces, with execution feedback recorded as observations available to subsequent model decisions. The system also introduces a reusable rule knowledge base, which turns recurring execution rules and acceptance criteria into runtime knowledge. LemonHarness further adds a time-aware execution mechanism that exposes elapsed and remaining budget to the model, so it can rebalance exploration, implementation, and validation effort as time pressure shifts and avoid timeouts from long waits or excessive verification. On Terminal-Bench 2.0, LemonHarness_GPT-5.3-CodeX reached 84.49% accuracy over 445 trials; pairing the same framework with the stronger GPT-5.5 backbone raised the average accuracy to 86.52% across five jobs. The results suggest that a unified runtime boundary, callable rule knowledge, and time-aware execution can improve the stability of long-horizon agent execution.
Tsinghua AI