Search papers, labs, and topics across Lattice.
This paper introduces Constraint-First Reasoning (CFR), a two-stage prompting protocol designed to enhance the mathematical problem-solving capabilities of large language models by explicitly extracting and summarizing constraints before solving. The approach significantly improves performance on various benchmarks, including AIME and AIMO_AMC, by ensuring that the model checks its intermediate and final answers against the extracted constraints. Notably, the method demonstrates that targeted interventions at test time can yield substantial benefits in accuracy without necessitating additional training.
Constraint-First Reasoning reveals that explicitly managing answer-space constraints can dramatically enhance the accuracy of mathematical problem-solving in language models.
Large language models can derive a plausible mathematical object yet still violate explicit requirements--for example, by omitting a modular reduction, returning a non-integer, or using the wrong encoded answer form. We introduce Constraint-First Reasoning (CFR), a training-free two-stage prompting protocol: Stage 1 extracts and summarizes constraints entailed by the problem, and Stage 2 solves while checking intermediate and final results against that summary. Routed-CFR activates the two-stage protocol only when a text-only regex router detects restrictive cues; otherwise it uses direct chain-of-thought (CoT). Across AIME, CMIMC, BRUMO, and AIMO_AMC, the method improves direct CoT on multiple backbones. We further report convention-controlled routing experiments, matched prompting baselines, problem-level paired tests, decoding robustness, constraint-quality audits, total-token accounting, and an OlympiadBench evaluation. These analyses position CFR as a targeted test-time intervention whose benefit depends on recoverable constraints and reliable Stage 1 extraction, rather than as a general-purpose replacement for mathematical reasoning.
Tsinghua AI