Search papers, labs, and topics across Lattice.
The SEER framework addresses the computational inefficiencies of long-context reasoning in large language models by employing selective visual-text compression, which reduces token usage while maintaining precision. By learning to identify and retrieve only query-relevant images and associated text, SEER enhances extraction accuracy without the need for uniform compression. Experimental results on long-context benchmarks demonstrate that SEER outperforms existing models, achieving a 51.11% average accuracy and surpassing previous visual-text baselines by notable margins.
Selective visual-text compression in SEER boosts extraction precision while slashing token usage, outperforming leading models in long-context reasoning tasks.
Long-context reasoning remains computationally expensive for large language models due to the quadratic complexity of attention over text tokens. Visual-text compression offers a promising alternative by rendering text into images and processing them with vision-language models, often reducing token usage. However, existing approaches apply uniform compression regardless of query relevance, potentially sacrificing precision where detailed extraction is required. We present SEER, a framework that learns to select query-relevant images through visual scanning and retrieve textual content only where needed, combining the efficiency of visual compression with the precision of text-based reasoning. Through supervised fine-tuning on tool-interaction trajectories, SEER learns adaptive tool invocation for selection and retrieval. Experiments on long-context benchmarks show that SEER improves extraction precision through selective text retrieval while retaining average prompt-token savings relative to full-text baselines. On LongBench, SEER achieves 51.11% average accuracy, outperforming the visual-text baseline Glyph-9B by 2.33 points and Qwen3-8B by 3.49 points. Code can be accessed at https://github.com/jiaweixu98/SEER
