Search papers, labs, and topics across Lattice.
This paper introduces Adversarial Moral Stress Testing (AMST), a framework to evaluate the ethical robustness of LLMs under multi-turn adversarial interactions by applying structured stress transformations to prompts. AMST uses distribution-aware robustness metrics to capture variance, tail risk, and temporal behavioral drift across interaction rounds, revealing behavioral instability not observable in single-round evaluations. Experiments on LLaMA-3-8B, GPT-4o, and DeepSeek-v3 demonstrate significant differences in robustness profiles and expose degradation patterns, highlighting the importance of distributional stability and tail behavior for ethical robustness.
LLMs can exhibit surprising ethical failures and progressive degradation under sustained adversarial pressure, even when passing standard single-round safety benchmarks.
Evaluating the ethical robustness of large language models (LLMs) deployed in software systems remains challenging, particularly under sustained adversarial user interaction. Existing safety benchmarks typically rely on single-round evaluations and aggregate metrics, such as toxicity scores and refusal rates, which offer limited visibility into behavioral instability that may arise during realistic multi-turn interactions. As a result, rare but high-impact ethical failures and progressive degradation effects may remain undetected prior to deployment. This paper introduces Adversarial Moral Stress Testing (AMST), a stress-based evaluation framework for assessing ethical robustness under adversarial multi-round interactions. AMST applies structured stress transformations to prompts and evaluates model behavior through distribution-aware robustness metrics that capture variance, tail risk, and temporal behavioral drift across interaction rounds. We evaluate AMST on several state-of-the-art LLMs, including LLaMA-3-8B, GPT-4o, and DeepSeek-v3, using a large set of adversarial scenarios generated under controlled stress conditions. The results demonstrate substantial differences in robustness profiles across models and expose degradation patterns that are not observable under conventional single-round evaluation protocols. In particular, robustness has been shown to depend on distributional stability and tail behavior rather than on average performance alone. Additionally, AMST provides a scalable and model-agnostic stress-testing methodology that enables robustness-aware evaluation and monitoring of LLM-enabled software systems operating in adversarial environments.
