Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a domain-specific large language model framework tailored for China's Multi-Level Protection Scheme (MLPS), addressing the limitations of manual interpretation and rule-based tools in compliance analysis. By integrating hierarchical retrieval, tree-based retrieval, and tokenization-based matching retrieval, the model enhances retrieval coverage while minimizing irrelevant context interference. Comparative experiments demonstrate that this approach significantly improves clause accuracy, conclusion traceability, and overall response quality in MLPS-related question answering tasks.
A domain-specific LLM for MLPS outperforms traditional methods, achieving superior accuracy and traceability in compliance analysis.
The Multi-Level Protection Scheme (MLPS) is a foundational system in China's cybersecurity governance framework. Therefore, accurate analysis and understanding of MLPS requirements are essential. At present, MLPS analysis still relies mainly on manual interpretation of standards and rule-based tools. This makes it hard to provide stable and consistent compliance analysis in complex application scenarios. The rise of large language models has created new opportunities for making MLPS work more intelligent. However, in standards-intensive and security-sensitive scenarios, general-purpose large language models often cannot ensure controllable reasoning or complete understanding of rules. This paper proposes a large language model framework for MLPS that integrates multiple retrieval strategies. It combines hierarchical retrieval, tree-based retrieval, and tokenization-based matching retrieval. This design helps maintain retrieval coverage while reducing the interference of irrelevant context in the reasoning process. To address the requirements of MLPS question answering for clause accuracy, conclusion traceability, and practical deployability, this paper adopts a evaluation method based on multi-dimensional weighted scoring to quantitatively assess model responses. In comparative experiments on ten typical questions, the proposed domain-specific large language model for MLPS achieved higher overall scores.