Search papers, labs, and topics across Lattice.
This paper introduces CausalOPD, a novel curriculum online process distillation framework designed to enhance causal chain reasoning in locally deployable models. By leveraging a knowledge-augmented teacher to identify and correct the first wrong step in a student's reasoning trajectory, the method significantly improves path correctness and reduces incorrect reasoning rates across multiple domains. The results show an impressive 23.4 percentage point increase in average path correctness compared to traditional sequence-level distillation, demonstrating the effectiveness of this approach in critical reasoning tasks.
CausalOPD reduces the right-label-wrong-reasoning rate from 15.7% to 4.4%, showcasing a breakthrough in accurate causal reasoning for AI models.
Many critical reasoning tasks, including clinical diagnosis, legal judgment, and industrial fault diagnosis, require step-dependent causal chains in which early errors propagate and correct conclusions can mask invalid reasoning. Although large language models perform well on such tasks, privacy, latency, and controllability motivate distillation into locally deployable models. Standard trajectory imitation does not correct process errors on the student's own rollout distribution. We propose CausalOPD, a curriculum online process distillation framework. A knowledge-augmented teacher first provides trajectories grounded in domain-specific causal rules, entity relations, and structural constraints. The student then generates on-policy trajectories, and the teacher identifies the first wrong step, defined as the earliest transition that verifiably violates available constraints. Starting from the verified prefix, short-horizon reinforcement learning repairs this localized failure. A causal-stage curriculum advances from evidence-level to mechanism-level and conclusion-level errors, following their propagation order. Across three domains, CausalOPD improves average path correctness by 23.4 percentage points over sequence-level online process distillation and reduces the right-label-wrong-reasoning rate from 15.7% to 4.4%. The domain-specific 8B students also surpass both evaluated proprietary references in path correctness across all domains.
