Search papers, labs, and topics across Lattice.
This paper challenges the notion of low chain-of-thought (CoT) controllability in reasoning models by proposing a "Self-Instructed CoT Controllability" evaluation. By embedding constraints as self-instructions within the model's CoT, rather than solely in the user prompt, researchers observed significantly improved adherence. This finding suggests that models possess greater inherent control over their reasoning processes than previously thought, with implications for both model utility and potential misuse in monitor evasion.
Reasoning models can achieve dramatically higher chain-of-thought controllability when instructed internally, not just externally.
Chain-of-thought (CoT) controllability, the ability of reasoning models to control properties of their CoT, is consequential for both their usefulness and reliable oversight. Recent work evaluates this capability by measuring whether models follow CoT constraints given in the user prompt, and reports very low controllability across models. We argue that this low controllability may not reflect an inherent inability of reasoning models to control their CoT, but instead result from naively specifying constraints in the user prompt. To test this, we introduce Self-Instructed CoT Controllability: a complementary evaluation that places the constraint as a self-instruction inside the model's CoT and measures its ability to follow it. We show that, under self-instruction, models achieve significantly higher controllability than with standard user instructions. Even a generic reminder to follow the user's constraint substantially improves controllability. Moreover, effective self-instructions can be bootstrapped into the reasoning through a simple instruction in the user prompt, enabling improved control even without access to the reasoning channel. Finally, using self-instruction, we demonstrate in a realistic monitoring setup that CoT controllability can be leveraged for monitor evasion, posing a risk to CoT monitorability.