Search papers, labs, and topics across Lattice.
To overcome redundant exploration and brittle trial-and-error in automated software configuration, the authors developed EnvPilot, an agent that persists and reuses structured operational knowledge across setup attempts. The framework extracts implicit problem-solving strategies from historical execution traces into an expandable memory base and uses context-aware retrieval to dynamically compose multi-step setup plans. Evaluated on AES-Bench鈥攁 newly constructed multilingual benchmark spanning 112 real-world repositories across 9 languages鈥擡nvPilot establishes a new state of the art with a 75.00% Pass@1 rate while simultaneously lowering inference reasoning costs.
Turning messy execution traces into structured episodic memory stops agents from repeating failed terminal commands, boosting autonomous environment setup to a 75% Pass@1 rate across nine programming languages.
Environment Setup is a critical yet complex task in software engineering that relies heavily on expert knowledge. Existing automated environment setup methods lack the ability to accumulate experience from past execution trajectories and to evolve over time. As a result, their performance is limited because they often perform redundant exploration, ignore useful past solutions, and fail to generalize across diverse software ecosystems. We present the systematic design and empirical validation of EnvPilot, an experience-augmented agent that operationalizes trajectory-derived experience reuse for software environment setup. EnvPilot maintains an expandable Trajectory-Derived Memory (TDM), initialized with 667 high-quality experiences. It systematically transforms implicit knowledge from historical execution trajectories into structured experience and retrieves the most relevant guidance during task execution through the Context-aware Retrieval mechanism. This enables EnvPilot to combine multiple validated setup strategies, providing more precise and detailed guidance than methods that rely solely on static project files or web retrieval. To evaluate EnvPilot, we construct AES-Bench, a multilingual benchmark of 112 real-world GitHub instances across 9 programming languages. Experiments show that EnvPilot achieves a new state-of-the-art (SOTA) with a 75.00% Pass@1 success rate while reducing reasoning costs. Our empirical study shows that both the structured experience representation and the Context-aware Retrieval mechanism are essential.
