Search papers, labs, and topics across Lattice.
This paper introduces AVISE, a modular open-source framework designed to identify vulnerabilities and evaluate the security of AI systems, addressing the critical need for systematic security assessments in AI. The framework includes an automated Security Evaluation Test (SET) that utilizes an Adversarial Language Model (ALM) to extend the Red Queen attack, achieving impressive metrics such as 92% accuracy and an F1-score of 0.91 when evaluating nine different language models. The findings reveal that all tested models are susceptible to the augmented attack, highlighting significant security vulnerabilities across diverse AI implementations.
All evaluated language models exhibit vulnerabilities to a novel adversarial attack, underscoring the urgent need for improved security measures in AI systems.
As artificial intelligence (AI) systems are increasingly deployed across critical domains, their security vulnerabilities pose growing risks of high-profile exploits and consequential system failures. Yet systematic approaches to evaluating AI security remain underdeveloped. In this paper, we introduce AVISE (AI Vulnerability Identification and Security Evaluation), a modular open-source framework for identifying vulnerabilities in and evaluating the security of AI systems and models. As a demonstration of the framework, we extend the theory-of-mind-based multi-turn Red Queen attack into an Adversarial Language Model (ALM) augmented attack and develop an automated Security Evaluation Test (SET) for discovering jailbreak vulnerabilities in language models. The SET comprises 25 test cases and an Evaluation Language Model (ELM) that determines whether each test case was able to jailbreak the target model, achieving 92% accuracy, an F1-score of 0.91, and a Matthews correlation coefficient of 0.83. We evaluate nine recently released language models of diverse sizes with the SET and find that all are vulnerable to the augmented Red Queen attack to varying degrees. AVISE provides researchers and industry practitioners with an extensible foundation for developing and deploying automated SETs, offering a concrete step toward more rigorous and reproducible AI security evaluation.
