Search papers, labs, and topics across Lattice.
SetupX is introduced as a novel framework that enables LLM agents to learn from past failures when setting up code repositories by addressing challenges like cross-repository experience transfer and multi-step trial-and-repair. It uses a Self-Evolving Experience Representation (XPU) to transfer verified environment fixes, Experience-Augmented Speculative Execution with Docker snapshots for safe rollbacks, and a Prosecutor-Judge Verification Protocol for reliable setup verification. Experiments demonstrate that SetupX achieves a 92% pass rate, outperforming existing methods by over 19%, especially in complex multi-repository setups.
LLM agents can now achieve a 92% success rate in complex code repository setup by learning from past failures, a 19% improvement over existing methods.
Functionality-correct repository setup aims to configure execution environments (e.g., dependencies, build scripts) to successfully execute a repository's documented features. It presents significant challenges due to diverse, repository-specific failures, including dependency incompatibilities, missing toolchains, incomplete installations, and verification-strategy mismatches. Existing LLM agents struggle to robustly resolve these issues, specifically failing to support (1) cross-repository experience transfer, (2) multi-step trial-and-repair under non-invertible state changes, and (3) robust verification of setup outcomes to distinguish setup-induced failures from repository bugs. To address this, we introduce SetupX, an experiential learning-based setup framework. First, we construct a Self-Evolving Experience Representation (XPU), a dual-modality knowledge unit encoding setup signals, textual guidance, executable actions to dynamically transfer verified environment fixes to unseen repositories. Second, we employ Experience-Augmented Speculative Execution backed by a LIFO Docker snapshot stack, enabling the agent to proactively trial fixes and safely roll back to known-good states. Third, we introduce a Prosecutor-Judge Verification Protocol that separates evidence collection from final judgment, enabling more reliable setup verification beyond superficial build-time metrics. Evaluation results on carefully-crafted benchmarks show SetupX achieves highest performance (e.g., 92% pass rate) and outperforms the strongest baseline by over 19%. Crucially, SetupX excels in complex multi-repository setup requiring coordinating multiple interconnected services across different containers. The code repository is available at https://github.com/OpenDataBox/SetupX.
