Search papers, labs, and topics across Lattice.
This paper introduces bootstrapped monitoring, a novel oversight protocol that integrates a stronger, untrusted model with transparent reasoning to enhance the reliability of AI monitoring systems. By employing a weaker trusted model to oversee the untrusted monitor's evaluations, the approach effectively mitigates the risks of collusion between the agent and the monitor. Evaluation on multi-turn software engineering tasks demonstrates that bootstrapped monitoring significantly improves detection rates of untrustworthy actions, even in scenarios where the untrusted monitor may collude with the agent.
Bootstrapped monitoring can dramatically enhance the reliability of AI oversight, even in the face of collusion between agents and their monitors.
Trusted monitoring is a cornerstone of AI control. However, as frontier models grow more capable, the increasing capabilities gap between trusted and untrusted models may render trusted models unreliable monitors. We introduce \emph{bootstrapped monitoring}, a protocol that addresses this by inserting a stronger, intermediate untrusted model with transparent chain-of-thought reasoning into the oversight chain. The untrusted monitor ($U_m$) evaluates the agent's actions, while a weaker trusted model ($T$) oversees $U_m$'s reasoning to detect collusion. We evaluate bootstrapped monitoring on multi-turn software engineering tasks (BashArena) across multiple agents and monitors. Bootstrapped monitoring substantially improves catch rates over trusted-only monitoring, even when the untrusted monitor actively colludes with the agent, provided we have access to its raw chain-of-thought. Our results suggest that bootstrapped monitoring can extend the useful lifetime of trusted models in control as AI capabilities advance.
