Search papers, labs, and topics across Lattice.
This paper introduces AxDafny, a verifier-guided framework for generating executable code alongside necessary proof artifacts in Dafny, enhancing the agentic capabilities of code generation models. By leveraging a new benchmark, LiveCodeBench-Pro-Dafny, which consists of 250 programming problems with formal specifications, AxDafny demonstrates a significant improvement in verification success rates compared to baseline models like GPT-5.5. The results reveal that AxDafny achieves a 92.7% verification success rate on DafnyBench, surpassing previous proof-hint baselines by 6.5 percentage points, while also highlighting the distinct metrics of verification success and runtime performance.
AxDafny achieves a remarkable 92.7% verification success rate, setting a new standard in agentic code generation for formal verification.
We study agentic code generation in Dafny, where a model must generate both executable code and the proof artifacts for verification. We present AxDafny, a verifier-guided repair framework that iteratively generates implementations, invariants, assertions, and termination arguments. We also introduce LiveCodeBench-Pro-Dafny (LCB-Pro-Dafny), a benchmark of 250 competition-style programming problems translated into Dafny with formal specifications and a verifier-based evaluation harness. On LCB-Pro-Dafny, AxDafny substantially improves verification success over baseline GPT-5.5 performance. On DafnyBench, AxDafny achieves 92.7\% verification success, outperforming the strongest previously reported proof-hint baseline by 6.5 percentage points. Lastly, we show that verification success and runtime test performance measure different aspects of generated code.
