Search papers, labs, and topics across Lattice.
This paper enhances IsabeLLM, an automated theorem proving tool, by integrating a Retrieval-Augmented Generation framework alongside error tracing and counterexample generation to improve context for Large Language Models. The research focuses on verifying Bitcoin's Proof of Work consensus protocol, a critical component of blockchain systems that are often targeted by malicious actors. Results indicate that the improved IsabeLLM significantly outperforms its predecessor in verification tasks, demonstrating the potential of AI to streamline formal verification processes for safety-critical systems.
Enhanced IsabeLLM can now verify Bitcoin's Proof of Work consensus more effectively, showcasing AI's transformative role in formal verification.
Advances in Artificial Intelligence (AI) have led AI for Theorem Proving to become a promising means of formally verifying computer systems. Whilst formal verification is traditionally reserved for safety-critical systems due to the required amount of expertise and effort, AI can help to automate a large amount of this workload and make it far more accessible. Blockchain-based systems are becoming increasingly popular and are frequently targeted by malicious actors, often resulting in huge financial losses, highlighting the need to better verify these systems and mitigate vulnerabilities. Arguably the most important component of these systems is the consensus protocol, which allows nodes to agree on decisions in a potentially adversarial environment. In this paper, we improve upon IsabeLLM, the automated theorem proving tool in Isabelle. Namely, we implement a Retrieval-Augmented Generation framework, Error tracing and counterexample generation for improved context supplied to the Large Language Model. Compatibility with the latest version of Isabelle and Sledgehammer is also implemented for improved efficiency. We compare the performance of the two versions of IsabeLLM in their ability to complete the verification of Bitcoin's Proof of Work consensus.
