Search papers, labs, and topics across Lattice.
This paper introduces a hybrid framework that integrates dynamic knowledge graphs and large language models (LLMs) to enhance science, technology, and innovation (STI) analytics by addressing the limitations of traditional bibliometric indicators. By organizing the framework into five layers, it ensures that LLM-generated semantic enrichments undergo rigorous validation processes, thus maintaining epistemic discipline while allowing for semantic flexibility. The key finding is that this approach yields a more responsive and semantically rich STI analytics system that aligns with scientific evidentiary standards, surpassing the capabilities of static bibliometrics.
Transforming STI analytics, this framework enables LLMs to generate insights that are not only richer but also rigorously validated against scientific standards.
Bibliometric indicators - citation counts, h-indexes, co-authorship networks - have long anchored science, technology, and innovation (STI) analytics, yet suffer from temporal lag, semantic shallowness, and an inability to capture the non-linear dynamics of contemporary knowledge ecosystems. Dynamic knowledge graphs and large language models (LLMs) have each been proposed as remedies, but neither is sufficient alone: existing scholarly knowledge graphs remain largely static, while LLM-driven pipelines are prone to hallucination, opacity, and corpus bias without structured grounding. This paper proposes a hybrid, symbolic-first framework integrating all three traditions under explicit methodological constraint. Organized across five layers - an open scholarly data backbone, a dynamic versioned knowledge graph, a constrained LLM-assisted semantic augmentation layer, a multi-layer validation pipeline, and an analytics layer - the framework positions LLMs strictly as generators of provisional candidate enrichments. Candidates become analytically admissible only after passing structural, evidentiary, comparative, and selective expert validation, with full provenance recorded at every stage. The analytics layer supports both established bibliometric indicators and extended graph-based analyses, including trend emergence detection, science-to-technology pathway mapping, and policy-oriented gap analysis. The framework's central theoretical contribution is treating validation as the mediating principle between semantic flexibility and epistemic discipline, enabling STI analytics that is semantically richer and temporally more responsive than static bibliometrics while remaining aligned with the evidentiary standards of science-of-science research. Governance considerations addressing reproducibility, bias, and auditability are also discussed.
