Search papers, labs, and topics across Lattice.
CIRF is introduced as an implicit Chain-of-Thought (CoT) framework that tokenizes explicit CoT traces into discrete, reusable functional units. The model is fine-tuned to generate these functional tokens and their results autoregressively, enabling parallel training and explicit rationale alignment. Experiments across mathematical, symbolic, and commonsense reasoning benchmarks demonstrate CIRF's superior accuracy-latency trade-off compared to existing implicit CoT methods.
Achieve faster LLM reasoning without sacrificing accuracy by compiling chain-of-thought rationales into reusable functional tokens.
Implicit Chain-of-Thought (CoT) reduces the inference cost of large language models by internalizing the explicit rationales. However, existing approaches typically lack alignment with explicit rationales and adaptivity to example complexity. In this work, we propose CIRF (\textit{\underline{C}hain-of-thoughts \underline{I}nto \underline{R}eusable \underline{F}unctional units}), an implicit CoT framework that performs reasoning as a dynamic sequence of discrete functional tokens. CIRF assigns a functional token to each semantically coherent reasoning unit in explicit CoT traces. The model is then fine-tuned to autoregressively generate functional tokens and their optional results, followed by the final answer. This design aligns latent reasoning with a sequence of functional units, facilitating parallel training, explicit rationale alignment, and adaptive reasoning. Extensive experiments on mathematical, symbolic, and commonsense reasoning benchmarks show that CIRF provides a favorable accuracy-latency trade-off compared with state-of-the-art implicit CoT methods. Further analyses demonstrate that CIRF constructs distinct, interpretable functional tokens, leading to consistent performance improvements.
