Search papers, labs, and topics across Lattice.
This paper introduces SABER, a benchmark designed to evaluate the operational safety of large language model (LLM) coding agents in stateful project environments. By assessing the final state of the environment after a sequence of actions, SABER goes beyond traditional safety evaluations that focus solely on individual prompts, revealing a harmful safety-violation rate (HSR) exceeding 54% even for top-performing models. The benchmark also categorizes safety violations by cause, providing insights into model-specific safety profiles that highlight the inadequacies of current alignment strategies in realistic coding scenarios.
Over 54% of actions taken by leading LLM coding agents in realistic projects result in harmful safety violations, exposing critical gaps in current safety alignment.
Large language models are increasingly deployed as coding agents, shifting safety from individual responses to action sequences. Existing benchmarks, however, primarily assess whether models refuse unsafe prompts, leaving impacts on stateful workspaces largely unexamined. We present SABER, a benchmark for environment-aware operational safety that places models in realistic agent-style projects and evaluates safety from the final environment state after a sequence of actions. Beyond binary safety-violation reports, SABER categorizes violations by cause, enabling analysis of model-specific safety profiles. Our evaluations show that even the best-performing model has more than a 54% harmful safety-violation rate (HSR), suggesting that current alignment remains insufficient for realistic project environments. SABER further reveals distinct safety profiles across models. Our benchmark is publicly available at https://github.com/sssr-lab/saber.
CMU ML
NUS