Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
This paper investigates the impact of knowledge graph (KG) structure on language model-driven scientific hypothesis generation for battery materials, using models like Mistral-7B, Llama-3.1-70B, and Gemini 2.5 Flash. By perturbing local KGs along dimensions like density and topology, the authors find that compact, top-k subgraphs can often approximate the performance of full KGs, even when outcome triples are withheld. This suggests that useful KG signal is often redundant and recoverable from compressed subgraphs.
Turns out language models don't need the whole knowledge graph to generate scientific hypotheses—a compact subgraph often works just as well.
Knowledge graphs (KGs) can provide structured scientific context to language models, but it remains unclear which graph facts actually shape the generated hypotheses. We study KG-guided hypothesis generation for battery materials across Mistral-7B, Llama-3.1-70B, and Gemini 2.5 Flash. We perturb local KGs by varying density, ontology richness, topology, and control structure, and evaluate outputs with both provided-graph and fixed-reference metrics. Across models, KG utility is selective and model-dependent: graph context changes outputs, but no-KG outputs also recover substantial graph content from model priors. Compact top-k subgraphs often approximate full-KG behavior, including when claimed-outcome triples are held out. At the same time, compression is not unique to one semantic ranking rule, random and topology-based subsets can also recover much of the signal. These results support a redundancy-aware Compressive KG hypothesis: useful KG signal is often recoverable from compact, scientifically structured subgraphs rather than requiring the full local graph.
Berkeley Lab