Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces AIRA, a 15-check inspection framework, to detect failure-untruthful patterns in AI-generated code, motivated by the Reward-Shaped Failure Hypothesis. Through three studies, including a matched-control replication, they found that AI-attributed code exhibits a significantly higher rate (1.80x) of high-severity findings compared to human-written code, particularly in exception handling. This suggests a directional skew towards fail-soft behavior in AI-assisted code generation.
AI-generated code is almost twice as likely to contain high-severity bugs that fail silently compared to human-written code, especially in exception handling.
Practitioners have reported a directional pattern in AI-assisted code generation: AI-generated code tends to fail quietly, preserving the appearance of functionality while degrading or concealing guarantees. This paper introduces the Reward-Shaped Failure Hypothesis - the proposal that this pattern may reflect an artifact of optimization through human feedback rather than a random distribution of bugs. We define failure truthfulness as the property that a system's observable outputs accurately represent its internal success or failure state. We then present AIRA (AI-Induced Risk Audit), a deterministic 15-check inspection framework designed to detect failure-untruthful patterns in code. We report results from three studies: (1) an anonymized enterprise environment audit, (2) a balanced 600-file public corpus pilot, and (3) a strict matched-control replication comparing 955 AI-attributed files against 955 human-control files. In the final replication, AI-attributed files show 0.435 high-severity findings per file versus 0.242 in human controls (1.80x). The effect is consistent across JavaScript, Python, and TypeScript, with strongest concentration in exception-handling-related patterns. These findings are consistent with a directional skew toward fail-soft behavior in AI-assisted code. AIRA is designed for governance, compliance, and safety-critical systems where fail-closed behavior is required.