Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper develops a framework for assessing the capability to infer in data-driven systems, particularly in the context of the European AI Act, which lacks a clear definition of inference. By analyzing credit scoring systems, the authors demonstrate that both individual models and the overall data processing workflow must be evaluated to determine compliance with the AI Act's inference requirements. The findings reveal that human expert involvement significantly impacts the inference capability, highlighting the need for clearer regulatory guidelines.
The framework reveals that the entire data processing workflow, not just individual models, is crucial for determining compliance with AI inference regulations.
The European AI Act is the first comprehensive regulation of artificial intelligence (AI), setting out extensive obligations, particularly for so-called high-risk and general-purpose AI systems. A key distinguishing feature of AI systems under the AI Act is the capability to infer. Since the AI Act does not clearly define what inference is, there is a gray area for certain data-driven systems. A specific example is credit scoring systems, which are listed by Annex III of the AI Act. At the same time, however, these are often implemented using statistical models for which it is unclear whether they have the capability to infer and thus fall under the AI definition of the AI Act at all. Motivated by statistical learning theory, this work develops a framework for grading different levels of the capability to infer. Based on the AI Act and the Commission Guidelines on the definition of an artificial intelligence system, we analyze which levels constitute sufficient capability to infer within the meaning of the AI Act and where further regulatory clarity is needed. We illustrate the framework by creating two realistic credit scoring workflows and show whether and where inference occurs in them. Our analysis illustrates that not only individual models but the entire data processing workflow must be considered. It also shows that the involvement of human experts during development can have significant influence on the capability to infer. Code can be found at https://github.com/fraunhofer-iais/inference-framework-creditscorecards.