Search papers, labs, and topics across Lattice.
This paper introduces SPARE, a Kullback-Leibler (KL)-guided framework designed to prune redundant reasoning in Multimodal Large Language Models (MLLMs) while preserving essential visual evidence. By leveraging a compact task-state summary as diagnostic context, SPARE effectively reduces the textual debt that accumulates during multi-step reasoning, achieving a significant reduction of 37.89–64.58% in reasoning tokens without compromising accuracy. The results demonstrate that this pruning approach enhances reliance on visual information, thereby improving overall task performance in multimodal tool-use scenarios.
Pruning 64.58% of reasoning tokens not only streamlines MLLM performance but also revitalizes the model's reliance on visual evidence, enhancing task accuracy.
Multimodal Large Language Models (MLLMs) are increasingly deployed as multi-step agents, where explicit reasoning supports task decomposition and tool coordination but also accumulates self-generated text. Over long trajectories, this text can dominate the context and suppress visual evidence, creating textual debt. We observe that reasoning becomes redundant once task-relevant visual evidence is grounded, while stale hypotheses can misguide later inference when grounding remains uncertain. Pruning must therefore remove redundant text without discarding visual evidence. We propose SPARE, a Kullback--Leibler (KL)-guided framework for pruning accumulated reasoning in multimodal tool-use agents. SPARE uses a compact task-state summary as privileged diagnostic context. For each candidate segment, it replays the same model under the original and summary-conditioned contexts. Reverse-KL divergence from on-policy self-distillation (OPSD) then tests whether the summary sufficiently covers the segment without disrupting future reasoning. We further fine-tune the summarizer with supervised fine-tuning (SFT), enabling more compact summaries, broader coverage, and more aggressive pruning. Across multi-step visual tool-use benchmarks, SPARE achieves the highest average accuracy among pruning methods while removing 37.89--64.58\% of reasoning tokens. This favorable accuracy--context trade-off shows that reducing textual dominance restores reliance on visual evidence and mitigates over-conditioning on self-generated language.
