Search papers, labs, and topics across Lattice.
This scoping review analyzes 4,259 documents to explore the role of system integration audits in AI, identifying 58 relevant studies that highlight the inadequacy of model-centric evaluations in addressing risks from component interactions and deployment environments. Through reflexive thematic analysis, the authors reveal that existing audits are fragmented, with significant gaps in addressing integration-specific risks and traditional audit expectations. The study categorizes integration into three sites鈥攊nter-component, system-environment, and multi-system鈥攅mphasizing the need for a more comprehensive approach to AI auditing that prioritizes system integration to mitigate risks effectively.
System integration audits reveal critical gaps in AI risk evaluation, exposing the limitations of current model-centric approaches.
As AI systems become increasingly integrated into diverse interfaces and applications, model-centric audits are insufficient to address risks arising from interactions among system components and deployment environments. System integration has long been central to software audits in safety-critical domains such as aerospace. However, its role in AI auditing remains underexplored. Scanning through 4,259 documents, we present a scoping review of AI audits that treat system integration as a core tenet of evaluation (n = 58). Using reflexive thematic analysis, we analyze their elements, actors, enablers, and constraints. We find that the corpus represents an emerging yet still fragmented form of AI auditing: few existing measures target integration-specific risks; large gaps remain in meeting traditional audit expectations; and access to necessary information and resources significantly influences audit design. Nonetheless, integration can be categorized across three sites (inter-component, system-environment, and multi-system), each serving the functions of risk exploration, risk determination, coordination, and procedural regularity. Deviating from other types of evaluations, these audits assess qualities specific to system integration, including compatibility, completeness, and oversight. This review calls on the AI community to prioritize system integration as a core strategy for addressing AI risk, and to develop audit practices capable of capturing failures across components, environments, and systems beyond the reach of component-level evaluation.
