Search papers, labs, and topics across Lattice.
This study investigates the effectiveness of scratchpad reasoning in models by comparing those that report only final states with those that write intermediate states before arriving at a final answer. The authors conducted a controlled state-tracking task, demonstrating that models trained to write intermediate states can accurately predict downstream consequences of edits to those states, achieving 80% and 91% accuracy in two task variants. These findings highlight the importance of intermediate state writing in enhancing model alignment and computational transparency.
Models that write intermediate states significantly outperform those that only report final answers, achieving up to 91% accuracy in predicting outcomes from edited states.
A central hope behind process supervision is that models can expose intermediate variables that matter for their later behavior. For this to help with alignment, a scratchpad must be tied to the computation: when the model writes a state, later steps should compute from that state. To test this requirement, we use a controlled state-tracking task with a known update rule, comparing models trained to report only the final state with models trained to write intermediate states before giving the final answer. At evaluation, we edit the internal representation of one written state while leaving the visible scratchpad text fixed. Because the transition rule is known, the edit has a single correct downstream consequence. In Qwen2.5-Coder-7B, the state-writing model predicts the next phase bit implied by the edited state on 80% and 91% of held-out examples across the two task variants, while pretrained and final-answer-only controls remain near baseline. Additional controls rule out generic next-token steering and copying another continuation: the prediction depends on both the edited state and the current move. The same causal-use pattern replicates across model families. Together, these results suggest a sharper goal for scratchpad oversight: not just to make intermediate reasoning legible, but to train written states that the model uses as part of its computation.