Search papers, labs, and topics across Lattice.
This paper introduces Generative Thread Intelligence (GenTI), a novel LLM-driven benchmark designed for the automatic generation of intrusion detection and prevention system (IDPS) rules targeting unseen attacks. By leveraging a comprehensive dataset of over 200k annotated rules and employing structured prompt engineering alongside Chain-of-Thought and Chain-of-Verification methodologies, GenTI significantly enhances the adaptability of IDPS to emerging threats. The results demonstrate a remarkable improvement in unseen attack detection from 45% to 87.4% and a reduction in false positives from 8.5% to 2.3%, achieving a composite rule-quality score of 89.4%.
Unseen attack detection skyrockets from 45% to 87.4% with GenTI's LLM-driven rule generation, redefining IDPS adaptability.
Rule-based Intrusion Detection and Prevention Systems (IDPS) offer precise attack detection as well as mitigation, however their manually crafted, signature-driven rules limit adaptability to emerging and zero-day threats. Additionally, existing public datasets (e.g., CICIDS2017, UNSW-NB15) focus on traffic classification and provide little structured information to support automatic rule synthesis or prevention logic. To address this gap, we propose Generative Thread Intelligence (GenTI) \footnote{GenTI refers to the proposed framework, and GTI refers to the dataset.} an LLM-driven benchmark for automatic generation of IDPS rules targeting unseen attacks. The dataset (GTI) aggregates over 150k detection and prevention rules from Snort, Suricata, Emerging Threats, as well as 50k YARA, each annotated with protocol behavior, payload signatures, contextual relationships, mappings to Cyber Threat Intelligence (CTI), along with actionable response types (alert, drop, reject). Moreover, on top of this corpus we design an LLM-based pipeline that transforms analyst prompts and representative payloads into deployable rules via structured prompt engineering, Chain-of-Thought (CoT) reasoning, as well as a Chain-of-Verification (CoVe) loop for syntactic, semantic, and security validation. The generated rules are executed in real time on (Snort/Suricata) and evaluated by syntax accuracy, semantic similarity, CTI coverage, security effectiveness as well as unseen attacks detection. Furthermore, our GenTI instantiation achieves a composite rule-quality score of 89.4\%, with 94.8\% CTI coverage, improving unseen attacks detection from 45\% to 87.4\% and reducing the false-positive rate from 8.5\% to 2.3\%. Overall, GenTI establishes the first large-scale benchmark that tightly couples rule-level CTI with LLM-based automation, enabling adaptive, self-evolving IDPS.
