Search papers, labs, and topics across Lattice.
This paper introduces TsuGO, a novel benchmark designed to evaluate the search efficiency of large language models (LLMs) through Go life-and-death problems, shifting the focus from mere accuracy to the organization of reasoning paths. By constraining the solution space, TsuGO allows for a detailed analysis of how models allocate reasoning resources and manage search organization, revealing that many current LLMs operate more like unguided search algorithms than efficient reasoning systems. The findings indicate that longer chains of thought or higher token efficiency do not necessarily correlate with improved search performance, highlighting critical gaps in existing evaluation methods.
Current LLMs struggle with structured reasoning, often resembling unguided search algorithms rather than efficient problem solvers, as revealed by TsuGO's rigorous benchmarking.
The evaluation of LLM reasoning is moving from final-answer accuracy to process-level assessment, yet existing methods still fail to capture how models plan reasoning paths and allocate reasoning resources--that is, how they organize search. Prior process-level methods focus on the coherence and redundancy of chain-of-thought (CoT), and most benchmark tasks have a single objective solvable by static capabilities such as derivation and tool use, leaving search organization unmeasured. We introduce TsuGO, a process-level reasoning benchmark for evaluating Search Efficiency in LLM reasoning through Go life-and-death problems. These problems provide closed and verifiable solution spaces with an inherent adversarial structure, making candidate generation, response checking, branch comparison, and backtracking necessary parts of reasoning rather than incidental trace patterns. By constraining the solution space, TsuGO disentangles domain knowledge from search organization, parses CoT into a structured search tree, and reports Search Efficiency together with Token Efficiency and other diagnostic metrics and visualizations. Experiments show that current LLMs remain far from stable tsumego solving: stronger models succeed by finding the correct candidate earlier and sustaining effort on productive branches, but most models still behave much closer to unguided search algorithms than to neural-guided KataGo. Longer CoT or higher Token Efficiency does not necessarily imply better search. Our results identify search organization and reasoning-resource allocation as missing dimensions in LLM reasoning evaluation.
