Search papers, labs, and topics across Lattice.
This paper advocates for the establishment of robust auditing frameworks for AI systems deployed in real-world environments, emphasizing the limitations of traditional evaluation methods that rely on static benchmarks. By framing auditing as a statistical problem focused on monitoring constraint violations under uncertainty, the authors highlight the importance of continuously assessing properties like fairness and safety as systems evolve. The proposed approach underscores the necessity for uncertainty-aware monitoring techniques and socio-technical specifications to ensure effective oversight throughout the AI lifecycle.
Auditing AI systems in real-world settings requires a shift from static benchmarks to dynamic, uncertainty-aware monitoring of fairness and safety constraints.
AI systems are increasingly deployed in real-world settings where their behavior is shaped by dynamic environments, evolving data distributions, and complex interactions with users and infrastructure. Traditional machine learning evaluation focuses on benchmarks and operates within sandboxed environments, providing only a limited view of the true system behavior in the wild. We argue for the development of principled auditing frameworks that monitor deployed AI systems throughout their lifecycle. We further propose framing auditing as a statistical problem of monitoring constraint violations under uncertainty, where desired properties (e.g., fairness and safety) are treated as risk-controlled constraints that must be continuously evaluated as systems evolve through iterative feedback. This perspective highlights the need for uncertainty-aware monitoring methods, socio-technical specifications of audit criteria, and auditing infrastructures that enable ongoing oversight of AI systems in the wild.
