Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the discrepancy in large language models' (LLMs) ability to self-correct versus correcting errors when claims are presented under different roles. By maintaining the content of erroneous claims while varying their presentation as either a self-generated thought or an external source, the authors found that correction rates increased significantly—by up to 93 percentage points—when claims were framed as external. This finding indicates that the inability of LLMs to self-correct is not due to a cognitive limitation but rather a byproduct of the chat-template structure used in interactions.
LLMs can dramatically improve their correction rates by simply changing the framing of claims, revealing a surprising role-label dependency in their reasoning processes.
Recent work shows that LLM agents struggle to correct errors in their own reasoning traces yet show markedly higher correction rates when identical claims appear under external sources. We ask whether this asymmetry reflects a capability deficit or a role-label artifact: does an agent's willingness to correct a wrong claim depend causally on the chat-template role that carries it, rather than on the claim's content? Our setup keeps the erroneous claim byte-identical across all conditions (SHA-256 verified) and varies only its wrapping role: the agent's own \role{<thought>}, a \role{user} message, a \role{tool} response, or a \role{system <memory>} block. Across 13 model-domain cells covering seven model families and three domains ($n{=}30$ paired tasks per cell), relabeling the claim from \role{<thought>} to an external role lifts the explicit-correction rate by 23 to 93 percentage points, with 10 of 13 cells reaching $p{<}0.001$. Further experiments confirm that the effect is asymmetric, mechanistically decomposable, and robust across domains. The failure to self-correct is not a cognitive deficit; it is a chat-template artifact. We exploit this artifact by designing a prompt-structure-only intervention that requires no training and no model modification, with its strongest role label being domain-dependent: \role{<memory>} dominates on math, while a plain \role{user} message dominates on logical deduction.