Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This research introduces the Governance-Aware Autonomous Testing Framework (GATF) to address the issues of hallucinations, compliance violations, and security risks in AI-generated test artifacts for autonomous software testing. By integrating governance validation, explainability analysis, and probabilistic risk assessment into the testing lifecycle, the framework significantly enhances the reliability and transparency of these artifacts. Experimental results show that GATF reduces governance-related risks by 89.6% and achieves high accuracy across several metrics, demonstrating its potential to improve operational security in autonomous testing systems.
Governance-aware testing frameworks can slash risks by nearly 90% while boosting artifact reliability and compliance accuracy to over 94%.
Artificial Intelligence (AI) and Large Language Models (LLMs) are increasingly used in autonomous software testing; however, AI-generated test artifacts often suffer from hallucinations, compliance violations, security risks, and limited explainability. To enhance the reliability, transparency, and trustworthiness of AI-generated testing artifacts, this research introduces the concept of Governance-Aware Autonomous Testing Framework (GATF). The framework extends the autonomous testing lifecycle with governance validation, explainability analysis, probabilistic risk assessment, compliance monitoring, as well as audit governance. Experiments were performed with Defects4J and PROMISE software engineering datasets. The proposed framework successfully reduced the governance-related risks by 89.6% and demonstrated 94.3% accuracy in governance, 96.5% artifact reliability, 94.2% compliance accuracy, and 90.8% explainability performance. The results show that autonomous testing systems that are governance-aware can significantly enhance the reliability, transparency, and operational security of autonomous testing systems in comparison to conventional AI-based testing systems. The proposed architecture is scalable and reliable and provides a safe environment for software testing.