Search papers, labs, and topics across Lattice.
This paper introduces Hypothesis Frontier, a verifier-guided neurosymbolic framework that enhances first-order concept synthesis by systematically evaluating LLM-generated formulas against training data. The method retains the most robust hypotheses across iterations while using remaining errors to inform further generation, effectively combining LLM outputs with symbolic reasoning to repair and simplify formulas. The results show that Hypothesis Frontier significantly outperforms traditional repeated prompt generation, solving more induction problems and compressing the resulting formulas without losing predictive accuracy.
Verifier-guided symbolic reasoning allows for solving more induction problems while simultaneously compressing the resulting formulas without sacrificing accuracy.
First-order concept synthesis asks a system to infer one formula that classifies labeled objects consistently across several finite relational structures. Every candidate can be evaluated exactly, but quantified first-order formulas form a vast search space, and LLM outputs are often semantically promising without being fully correct. We introduce Hypothesis Frontier, a verifier-guided neurosymbolic framework that evaluates each LLM formula on every training object, retains the strongest verified hypothesis across rounds, and uses its remaining errors to guide subsequent generation. Symbolic processing repairs invalid formulas while remaining anchored to the LLM-generated hypothesis, and simplifies train-valid formulas without changing any training prediction. Under matched models, problem sets, and LLM-round budgets, Hypothesis Frontier solves substantially more problems than repeated original-prompt generation. After the final formulas are selected, exact simplification shortens many train-valid formulas while preserving every training prediction. Exact symbolic reasoning therefore helps both to solve more induction problems and to compress many of the resulting formulas.
