Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
TreeThink is an open-source Python library designed for modular and fully asynchronous tree search in neural theorem proving, addressing the limitations of existing libraries that primarily focus on natural language reasoning without formal verification integration. By combining established tree search methods with vLLM-based inference and various node evaluation techniques, TreeThink supports multiple formal languages and enables real-time verification through direct connections to their REPL servers. Evaluation on datasets like miniF2F and MATH500 shows that TreeThink facilitates cross-language formal proof search and natural language reasoning, achieving up to a 6.3× speedup in wall-clock time due to its asynchronous execution capabilities.
Achieving up to 6.3× speedup in formal proof search, TreeThink revolutionizes how LLMs can integrate with formal verifiers for enhanced mathematical reasoning.
Tree search algorithms enable systematic exploration of the proof space in neural theorem proving. Existing LLM tree search libraries primarily target natural language reasoning and do not provide native integration with formal verifiers, while theorem proving systems often rely on task-specific search implementations. We introduce TreeThink, an open-source Python library for modular, fully asynchronous tree search in neural theorem proving. It integrates established tree search methods with vLLM-based inference pipelines and diverse node evaluation techniques, ranging from lightweight heuristics to neural evaluators. We support Lean~4, Rocq, and Isabelle/HOL alongside natural language. It connects directly to each language's Read-Eval-Print Loop (REPL) server for real-time verification and proof state extraction. We evaluate TreeThink on miniF2F and MATH500, demonstrating cross-language formal proof search, natural language reasoning support, and up to 6.3$\times$ wall-clock speedup from asynchronous execution. Source code is released under the MIT license at https://github.com/GGLAB-KU/treethink , and the library is accessible as a downloadable package at https://pypi.org/project/treethink/ .