Search papers, labs, and topics across Lattice.
This paper introduces the Hypergraph-Based Paired Failure Attribution (HPFA) framework, which enhances the accuracy of failure attribution in LLM reasoning by leveraging hypergraph structures to compare failure paths with successful ones. By efficiently reducing the search space for root cause localization, HPFA allows for the scalable synthesis of attribution data, which is then used to train a lightweight attributor model through supervised fine-tuning and reinforcement learning. Experimental results on mathematical reasoning and agentic coding tasks show that HPFA significantly improves both attribution accuracy and reasoning performance compared to existing methods that do not utilize graph structures or paired analysis.
Hypergraph-based failure attribution can boost LLM reasoning accuracy by efficiently pinpointing the root causes of errors, outperforming traditional methods.
Reflection is a powerful mechanism for LLM reasoning, yet its effectiveness hinges on accurately attributing failures to specific reasoning steps, a capability that current models notably lack. Existing failure attribution methods either require expensive step-by-step counterfactual testing that scales poorly with trajectory length, or treat reasoning traces as flat sequences that ignore the inherent non-linear logical dependencies. We propose a hypergraph-based paired failure attribution (HPFA) framework that attributes the failure root cause by comparing the hyperedges of the targeted failure reasoning path against a reference successful path. By reducing the search space, our method efficiently localizes root causes and enables scalable synthesis of attribution data for training a lightweight attributor model via supervised fine-tuning and reinforcement learning. Experiments on mathematical reasoning and agentic coding tasks demonstrate that HPFA can dramatically increase attribution accuracy and efficiency, and the trained attributor consistently improves reasoning accuracy at test time, outperforming baselines that lack graph structure or paired analysis.
NUS