Hasan Demirkiran

Safety guard evaluations can be misleadingly inflated by superficial cues, with simple edits to tool names or command structure significantly altering measured performance and agent behavior.

Agent guards designed for English requests exhibit significant safety failures when faced with multilingual inputs, with smaller models and specialized guards showing the most pronounced language-dependent biases.