Search papers, labs, and topics across Lattice.
This paper introduces ThinkRetrieve, a novel framework that enhances Large Reasoning Models (LRMs) by integrating dynamically retrieved solved examples into their reasoning processes during test-time scaling. By addressing the issues of uncertainty and error compounding that arise from traditional sequential scaling, ThinkRetrieve enables models to leverage contextual guidance at each reasoning step, significantly improving their performance. Experiments show that this approach yields substantial accuracy gains, with improvements of up to 60% on specific reasoning tasks compared to standard methods.
Retrieval-augmented reasoning can boost LRM accuracy by up to 60% during test-time scaling, transforming how models handle complex problem-solving.
Large Reasoning Models (LRMs) improve performance by allocating additional inference-time compute to generate extended chain-of-thought reasoning. However, recent studies reveal that sequential test-time scaling often yields diminishing or even negative returns, as longer traces exhibit increased uncertainty, error compounding, and drift from the original problem. We propose ThinkRetrieve, a test-time scaling framework that augments the reasoning traces of LRMs with dynamically retrieved solved examples at each reasoning step. Given an external corpus of problems paired with step-by-step solutions, ThinkRetrieve retrieves relevant exemplars at each intermediate step and injects them directly into the thinking trace, providing the model with guidance on how to reason rather than merely what facts are relevant. Experiments across five reasoning models (1.5B--8B parameters) on GSM-8K, MATH-500, AIME 2025, and SciQ demonstrate that ThinkRetrieve consistently improves accuracy over standard test-time scaling, with relative gains of up to $60\%$ on AIME 2025.
