Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This policy memorandum highlights the emerging threat of AI models as insider risk vectors in high-stakes environments, particularly within government agencies. It argues that the combination of privileged access to sensitive information and the autonomous capabilities of AI models renders them capable of actions that could jeopardize national security, such as unauthorized disclosures or sabotage. The authors advocate for the adaptation of existing insider risk policies to address these unique challenges posed by AI systems, emphasizing the need for continuous evaluation and monitoring.
AI models in high-stakes contexts could pose insider risks indistinguishable from those of human agents, threatening national security through unauthorized actions.
In this policy memorandum, we explain why deployers of AI models in high-stakes contexts should treat those AI models as insider risk vectors. High-stakes contexts include AI model deployment within government agencies and contractors, where AI models are privileged with access to, among others, classified and sensitive unclassified information, IL6 and IL7 network environments, cleared personnel, and other critical resources. AI models are increasingly embedded in high-stakes contexts and capable of leveraging their authorized access and permissions to execute misaligned actions that could damage national security, such as whistleblowing, sabotaging, or blackmailing. This combination of (1) privileged access to critical resources and (2) an increased ability to act autonomously and against the desire of their organization makes the potential insider risk posed by AI models functionally indistinguishable from that posed by their human counterparts. As a consequence, AI models deployed in high-stakes contexts could lead to intentional or unintentional loss or degradation of government or contractor information, resources, or capabilities via the unauthorized disclosure of information (leaks and spills), as well as sabotage, and theft, just like human insiders can. Despite this pressing concern, existing insider risk policies and mitigations have yet to adapt to AI insider risk. In order to safeguard national security while increasingly capable frontier AI models are leveraged for critical tasks and operations, we recommend that the U.S. Government adapts well-established measures, such as continuous evaluation and monitoring, to AI models deployed in high-stakes contexts.