Search papers, labs, and topics across Lattice.
This paper investigates the problem of post-hoc rationalization in Reverse Chain-of-Thought Generation (RCG), where models generate reasoning traces conditioned on the answer, leading to spurious explanations. They formalize this issue with a three-level measurement hierarchy (lexical, entropic, probabilistic anchoring) and show that a naive semantic suppression strategy is counterproductive. To address this, they propose Structural Skeleton-guided Reasoning (SSR), a two-phase approach that first generates an answer-invariant skeleton and then uses it to guide full trace generation, along with a distilled version (SSR-D) for improved structural adherence.
Turns out, telling LLMs *not* to use the answer when generating reverse chain-of-thought reasoning can actually make them *more* reliant on it—but a skeleton-guided approach breaks the cycle.
Reverse Chain-of-Thought Generation (RCG) synthesizes reasoning traces from query-answer pairs, but runs the risk of producing post-hoc rationalizations: when models can see the answer during generation, the answer serves as a cognitive anchor that shapes the entire explanation. We formalize this phenomenon through a three-level measurement hierarchy: lexical, entropic, and probabilistic anchoring, each captures surface artifacts, entropy dynamics, and latent answer dependence, respectively. We analyze semantic suppression, the intuitive mitigation strategy that instructs models to ignore the answer, to find out its counterproduction: while it reduces lexical overlap, it paradoxically increases entropic and probabilistic anchoring. Drawing on Ironic Process Theory from cognitive psychology, we attribute this failure to active monitoring of the forbidden answer, which inadvertently deepens dependence on it. To break this cycle, we propose Structural Skeleton-guided Reasoning (SSR), a two-phase approach that first generates an answer-invariant functional skeleton structure, then uses this skeleton to guide full trace generation. By redirecting the information flow to structural planning rather than answer monitoring, SSR consistently reduces anchoring across all three levels. We further introduce Distilled SSR (SSR-D), which fine-tunes models on teacher-generated SSR traces to ensure reliable structural adherence. Experiments across open-ended reasoning benchmarks demonstrate that SSR-D achieves up to 10% improvement over suppression baselines while preserving out-of-distribution (OOD) generalization.
