Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This report analyzes the operational challenges of implementing JSP 936 Part 1 for AI assurance within UK Defence, identifying eight thematic areas that hinder effective governance. It highlights issues such as the adequacy of evidence, human interaction management, and the complexities of AI performance assessment, all of which stem from the socio-technical nature of AI systems. The findings underscore that while JSP 936 offers a governance framework, successful implementation is contingent upon addressing significant technical and organizational uncertainties.
Operationalizing AI assurance in UK Defence is fraught with challenges that could undermine the ambitious goals of JSP 936.
This report examines practical challenges in operationalising JSP 936 Part 1 for AI assurance in UK Defence. Using a structured interpretive review of the directive's requirements, the analysis identifies eight thematic challenge areas adequacy of evidence and argument, management of human interaction with AI, definition of the operational environment, integration of AI within systems of systems, assessment and maintenance of AI performance, analysis of safety and security, measurement of ethicality, and mitigation of the inherent complexities of AI. The report argues that JSP 936 provides a useful governance basis, but that implementation depends on unresolved technical, organisational, and assurance questions. These challenges stem from the socio-technical nature of AI-enabled systems, uncertainty in real-world deployment contexts, limitations in current assurance methodologies, and tensions between performance, safety, human oversight, security, and ethical acceptability. The report identifies areas where further methods, guidance, and organisational capability are needed for the ambitious, safe, and responsible adoption of AI across Defence. This is consistent with MOD's own framing of JSP 936 as requiring iterative implementation and supporting guidance.