Search papers, labs, and topics across Lattice.
This paper systematically reviews the integration of tree search methods into inference processes for large language models (LLMs), emphasizing Test-Time Scaling (TTS) as a means to enhance reasoning capabilities by treating inference as a search over partial reasoning states. The authors critique existing approaches, particularly single-trajectory decoding, for their limitations in error recovery and exploration, and propose a unified design space that encompasses various search strategies and evaluation metrics. Key findings highlight the advantages of Monte Carlo Tree Search (MCTS) in balancing exploration and exploitation, paving the way for more robust inference strategies in LLMs.
Tree search methods can significantly enhance reasoning in LLMs, revealing that traditional decoding approaches may be holding back their potential.
As pretraining scaling laws approach saturation, Test-Time Scaling (TTS) has emerged as an important direction for improving reasoning by allocating inference-time compute to a fixed model prior. Viewed at a high level, TTS reframes inference as search over a space of partial reasoning states. While Chain-of-Thought (CoT) exposes intermediate steps, common instantiations rely on single-trajectory decoding, limiting recovery from early errors and exploration. This survey systematizes recent progress in tree-search-based reasoning, viewing inference as instance-specific optimization rather than decoding. We trace the evolution from uninformed search to Monte Carlo Tree Search (MCTS), highlighting how sampling-based control supports principled exploration-exploitation trade-offs. To unify a fragmented literature, we introduce a Unified Design Space spanning search topology, evaluation signals, and control dynamics, and advocate a standardized compute-reporting abstraction to make compute-accuracy trade-offs explicit and comparable.
