Search papers, labs, and topics across Lattice.
This paper introduces EntailLLM, a system that validates LLM-generated vulnerability discovery paths by aligning them with independent domain knowledge through entailment in temporal annotated logic. By applying this method across various CWE classes and LLMs, the authors demonstrate a significant increase in entailment accuracy from 78% to 98%, with minimal degradation in performance across experiments. The end-to-end deployment on real medical-device binaries showcases the system's robustness and its ability to provide explainable and semantically grounded verification of LLM outputs.
Validating LLM-generated vulnerability paths with domain knowledge boosts entailment accuracy to 98%, transforming the reliability of AI in safety-critical applications.
Large language models are increasingly used to reason about software vulnerabilities, but their outputs can silently violate domain knowledge, limiting their reliability in safety-critical settings such as medical devices. Prior work either treats that output as a prediction to be scored or constrains it to walks within a single knowledge graph; neither checks whether reasoning over a binary is consistent with an independent body of domain knowledge. We present EntailLLM, which validates each LLM-proposed analyst path by entailment: the path is a traversal of the binary's function call graph, the domain knowledge is represented in a separate graph, and verification aligns the two under temporal annotated logic. Across three CWE classes, four LLMs, three prompting strategies, and seven binaries varying in size from 405 to 12,696 function call-graph nodes, domain knowledge raises pooled entailment from 78% to 98%, with entailment decreasing in only 3% of the experiments. EntailLLM is deployed end-to-end on real medical-device binaries, reaching 98% pooled entailment without per-device tuning. Our system inherits the formal guarantees of generalized annotated logic, providing logical verification of LLM output that is both explainable and grounded in well-defined semantics.
