Search papers, labs, and topics across Lattice.
The paper introduces the Structural Gap Hypothesis Agent (SGHA), a local language model-based system designed for automated research problem discovery that utilizes a structured corpus of scientific literature. By creating evidence-linked paper objects and a typed evidence graph, SGHA identifies unresolved patterns and formulates traceable research problems, including assumptions and success criteria. The results indicate that SGHA can generate inspectable research problems effectively, outperforming existing models while avoiding reliance on proprietary APIs, thus addressing issues of transparency and data governance in AI-driven research.
SGHA reveals that a structured corpus and evidence-constrained reasoning can yield more reliable and auditable research problem formulations than traditional frontier models.
Recent efforts toward fully automated AI scientists have demonstrated that language-model agents can generate hypotheses, execute experiments, and draft scientific manuscripts. However, during the early stages of research, when research problems are formulated, these AI scientists often rely heavily on proprietary frontier models. Their proposals are shaped by opaque parametric knowledge and by literature searches conditioned on the proposals themselves. Such knowledge is effectively a black box, and this dependence makes the evidential basis and validity of generated research problems difficult to audit and leaves the process vulnerable to model-specific hallucinations and biases. Furthermore, if proprietary research materials are transmitted to external APIs, the use of these models creates confidentiality, privacy, and data-governance concerns. We introduce the Structural Gap Hypothesis Agent (SGHA), a fully automated, corpus-first research-problem discovery system that runs entirely on a local LLM. SGHA structures a scientific literature corpus into evidence-linked paper objects and a typed evidence graph, detects unresolved structural patterns across papers, screens candidate gaps before formulation, and produces traceable research-problem families. In particular, it is able to output assumptions, objectives, success criteria, and remaining ambiguities. All LLM-based components of SGHA are executed using a locally served open-weight 9B language model, without requiring proprietary frontier-model APIs. We compare SGHA with the AI Scientist-v2 idea formulation module in five machine-learning domains. Our results suggest that explicit corpus structure and evidence-constrained reasoning can support promising, inspectable research-problem formulation without relying on frontier models during generation or verification.
