Search papers, labs, and topics across Lattice.
This paper introduces Fork-think with confidence, a novel approach that shifts from the traditional think-first-then-decide paradigm to a decide-first-then-think methodology for reasoning tasks in large language models (LLMs). By identifying forking points based on model confidence before generating multiple continuations, this method significantly reduces token consumption by up to 30% and run-time by up to 57%, while maintaining or improving performance compared to existing parallel thinking strategies. The findings suggest that pre-determined forking can enhance the efficiency of LLM reasoning without the need for retraining or extensive warm-up phases.
Fork-think reduces token usage by 30% and runtime by 57% while achieving superior reasoning performance, challenging the efficiency of traditional methods.
Parallel thinking has enjoyed great success for boosting LLM performance on reasoning tasks without the need for any re-training. However, existing methods follow a think-first-then-decide paradigm, i.e., they first sample multiple reasoning paths, which inevitably leads to overgeneration, then prune or stop unnecessary paths to compensate. In contrast, decide-first-then-think, i.e., first identifying points that are likely to lead to desirable generations, has been underexplored so far. Following this paradigm, we propose Fork-think with confidence, that first identifies forking points using model confidence in a single seeding path, then triggers thinking, sampling multiple continuations and aggregating them for the final response. Our experiments across three models and three reasoning benchmarks show that Fork-think reduces the token consumption by up to 30% and run-time by up to 57%, while performing comparable to or better than parallel thinking. Our analysis reveals that Fork-think is able to identify forking points that are meaningful with respect to the downstream task and that sampling at later positions can lead to substantially better generations. Finally, we demonstrate how combining Fork-think with existing mechanisms such as early stopping and weighted voting can further boost the performance and perform comparably to existing state-of-the-art methods, without requiring any warm-up or offline training. Our results establish pre-determined forking as a promising research direction for efficient LLM reasoning.
