Search papers, labs, and topics across Lattice.
This paper introduces EDGE, a framework that utilizes an Error Dependency Graph to improve multi-error attribution in large language model (LLM) systems by modeling the interdependencies between errors rather than treating them in isolation. By constructing an error dependency graph from observed error events and validating it through counterfactual rollouts, EDGE enhances the reliability of error attribution and provides a robust basis for explanation and repair analysis. Experimental results demonstrate that EDGE significantly improves category-level multi-error attribution across various models and prompting strategies, highlighting the importance of understanding error dependencies in LLM failures.
Multi-agent LLM systems can misfire due to interconnected errors, and EDGE reveals how understanding these dependencies dramatically enhances error attribution accuracy.
Large language model (LLM) agent failures often contain multiple related errors rather than a single mistake. Existing attribution methods usually identify a responsible agent, step, or root cause, but do not explicitly model dependency between errors. We introduce EDGE, an Error Dependency Graph-guided multi-Error attribution framework. EDGE constructs an error dependency graph from observed error events and validates a reliable causal subset through counterfactual rollout. The inference graph guides a two-stage LLM-as-judge detector for error attribution, and the intervention-validated subgraph provides a more reliable basis for explanation and repair analysis. Experiments on TRAIL and MAST show that EDGE improves category-level multi-error attribution across most evaluated models and settings. Experiments with adapted Who&When-style prompts show that the graph helps across prompting strategies. These results suggest that dependency structure is a useful diagnostic prior for agent failures beyond isolated root-cause prediction.
