Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper benchmarks the impact of "thought streams" (internal reasoning traces) on video scene understanding using Gemini 2.5 Flash and Flash Lite, evaluating whether more reasoning leads to better outputs, where gains plateau, and the content of these thought streams. They introduce metrics like Contentfulness, Thought-Final Coverage, and Dominant Entity Analysis, using GPT-5 as a judge. The key finding is that quality gains from additional thinking plateau rapidly, with Flash Lite offering a better balance between quality and token usage, and that tight reasoning budgets lead to compression-step hallucinations.
Gemini's video reasoning hits diminishing returns fast: most gains come in the first few hundred tokens, and cheaper models can outperform with better token efficiency.
We benchmark how internal reasoning traces, which we call thought streams, affect video scene understanding in vision-language models. Using four configurations of Google's Gemini 2.5 Flash and Flash Lite across scenes extracted from 100 hours of video, we ask three questions: does more thinking lead to better outputs, where do the gains stop, and what do these models actually think about? We introduce three evaluation metrics. Contentfulness measures how much of the thought stream is useful scene content versus meta-commentary. Thought-Final Coverage measures how faithfully the thought stream translates into the final output. Dominant Entity Analysis identifies which subjects, actions, and settings the model focuses on. GPT-5 serves as an independent judge. We find that quality gains from additional thinking plateau quickly, with most improvement occurring in the first few hundred tokens. Flash Lite offers the best balance between quality and token usage. Tight reasoning budgets cause the model to add content in the final output that it never reasoned about, a form of compression-step hallucination. Despite being different model tiers, Flash and Flash Lite produce similar thought streams, though they differ in style: Flash discusses its reasoning process, while Lite focuses on describing the scene.