Search papers, labs, and topics across Lattice.
The paper introduces Echo, a framework for continuously learning from AI agent interaction data by leveraging user refinements as high-quality training signals. Echo harvests user-corrected agent proposals to align the agent with real-world needs, effectively distilling noisy interaction logs into learnable knowledge. Validated in a production code completion environment, Echo increased the acceptance rate from 25.7% to 35.7%, demonstrating its ability to break static performance ceilings.
User corrections of AI agents are a goldmine: Echo shows how to automatically transform these noisy interactions into a 10% absolute improvement in code completion acceptance rates.
Static "human data" faces inherent limitations: it is expensive to scale and bounded by the knowledge of its creators. Continuous learning from "experience data" - interactions between agents and their environments - promises to transcend these barriers. Today, the widespread deployment of AI agents grants us low-cost access to massive streams of such real-world experience. However, raw interaction logs are inherently noisy, filled with trial-and-error and low information density, rendering them inefficient for direct model training. We introduce Echo, a generalized framework designed to operationalize the transition from raw experience to learnable knowledge, effectively "echoing" environmental feedback back into the training loop for model optimization. In today's agent ecosystem, user refinement serves as a primary source of such feedback: driven by responsibility for the outcome, users rigorously transform flawed agent proposals into verified solutions. These user-driven refinement sequences inherently distill agents' crude attempts into high-quality training signals. Echo systematically harvests these signals to continuously align the agent with real-world needs. Large-scale validation in a production code completion environment confirms that Echo effectively harnesses this pipeline, breaking the static performance ceiling by increasing the acceptance rate from 25.7% to 35.7%.
