Search papers, labs, and topics across Lattice.
This position paper argues that AI safety requires explicit controllability mechanisms, beyond just alignment, to ensure reliable interruptibility, overridability, redirectability, and constraint during runtime. They introduce ControlBench, a benchmark to evaluate controllability failures in agentic scenarios, revealing that current alignment techniques often fail to provide persistent runtime control. The authors propose a control-centric architectural framework emphasizing explicit control planes, intervention pathways, persistent control states, and auditable decision interfaces.
Alignment isn't enough: truly safe AI demands robust runtime controllability, which current methods often fail to provide.
AI safety is still largely framed as alignment: training models to follow human preferences, safety policies, and normative constraints. That framing has improved the behavior of modern language models, but aligned behavior does not by itself guarantee that a deployed agent can be stopped, overridden, or constrained once it operates in open-ended, interactive, and tool-using environments. A system may be safe in expectation and still fail to yield to explicit runtime authority under conflicting instructions, long-horizon execution, adversarial inputs, or risky tool use. This position paper argues that AI safety therefore requires controllability as a first-class objective. We define \emph{controllability} as the ability of an AI system to remain reliably interruptible, overridable, redirectable, and constrainable by explicit control signals at runtime while preserving ordinary utility when such signals are absent. To study this gap, we introduce \controlbench{}, a benchmark for evaluating controllability failures in high-risk agentic scenarios. Experiments with OpenClaw-based agents show that current alignment and guardrail mechanisms reduce risk, but often fail to provide persistent, authoritative, and enforceable runtime control. We therefore propose a control-centric architectural framework that highlights explicit control planes, runtime intervention pathways, persistent control states, and auditable decision interfaces as key design principles for future controllable AI systems.
